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IMAGE DIAGNOSIS SUPPORTING DEVICE 

CROSS-REFERENCE TO RELATED APPLICATION 

The present application is a continuation-in- 
part of copending U.S. Patent Application No. 
10/312,779, filed December 30, 2002 entitled "Image 
5 Diagnosis Supporting Device" by GOTO, et al which is a 
Patent Application entered to the national phase of 
International Application No. PCT/ JP01/05703, filed 
July 2, 2001, International Laid-open No. WO 02/02002 
Al, the disclosures of which are hereby incorporated by 
10 reference. 

BACKGROUND OF THE INVENTION 

The present invention relates to an image 
diagnosis supporting device, which extracts a shadow 
that serves as a focus candidate (a possibly diseased 

15 portion) from a medical image by computerized image 
processing and displays the extracted shadow as is a 
focus candidate so that it can be identified. 

A computerized image diagnosis supporting 
device analyzes shadows in a medical image by using a 

20 computer, and displays a medical image containing a 
focus candidate shadow selected from the shadows, 
thereby presenting such medical image to a doctor who 
has been requested to make a diagnosis. The term 
"medical image" used herein covers photographic images 
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photographed with medical image diagnosis devices, such 
as CT devices, MRI devices and ultrasonic diagnosis 
devices, as well as difference images between past 
images and current images and the like. As to the 
5 method of selecting a focus candidate, several examples 
associated with medical images of lung areas have been 
reported in meetings and the like. Among the reports, 
there is a method of discriminating between a blood 
vessel shadow having an elongated shape and a cancer 

10 shadow having a shape close to that of a circle in a 
medical image of a lung area, for example, a "Quoit 
Filter" (refer to Journal of Computer Aided Diagnosis 
of Medical Images, Vol. 9, Page 21, November 1999). 
During a diagnosis of a medical image of a lung area, 

15 since the medical image contains not only a shadow of a 
cancer candidate, but also shadows such as blood 
vessels, cross sections of blood vessels and cross 
sections of bronchi, and various shadows have various 
sizes and shapes, it is desirable that only the shadow 

20 of the cancer candidate be extracted from the other 
shadows and be presented to the doctor. 

However, the above-described image diagnosis 
supporting device is difficult to use, because a lot of 
time-consuming work is required to adjust the 

25 parameters for specifying the sizes and shapes of 
various shadows. 

An object of this invention is to provide an 
image diagnosis supporting device that is capable of 
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reducing the computing time of a computer by handling 
shadows of different sizes and shapes in an integrated 
manner when a decision as to whether a shadow is a 
focus candidate of a medical image is to be 
5 automatically made by the use of the computer. 

Another object of this invention is to 
provide an image diagnosis supporting device that is 
capable of easily and instantaneously displaying a 
shadow which seems to be an extracted focus candidate. 

10 SUMMARY OF THE INVENTION 

To achieve the above object, an image 
diagnosis supporting device according to this invention 
includes digitizing means for applying predetermined 
image processing to a medical image and for generating 

15 a multi-valued image, and extracting means for 

executing at least one decision process on the multi- 
valued image and/or the medical image generated by the 
digitizing means and for extracting a shadow which 
seems to be a candidate for a focus, which device 

20 identifiably displays in the medical image the focus 
candidate shadow extracted by the extracting means. 

In addition, since the probability that the 
focus candidate shadow is a focus (focus certainty) can 
be determined, when the focus candidate shadow is 

25 displayed by being enclosed with a marker or the like, 
the marker is given a size or a thickness corresponding 
its focus certainty. 
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For example, markers are displayed in 
different colors in the order of the highness of the 
focus certainty, like red, yellow and blue, or are 
flash-displayed in such a manner as to blink their 
5 luminance, or are displayed in a combined manner of 
display in different colors and flash display. 

Other objects, features and advantages of the 
invention will become apparent from the following 
description of the embodiments of the invention taken 
10 in conjunction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a schematic block diagram of the 
hardware to which this invention is applied; 

Figs . 2a and 2b, when combined, comprise a 
15 main flowchart of the process of focus candidate 
extraction and display; 

Fig. 3 is an image processing flow diagram 
showing the processing of a CT image according to the 
flowchart of Figs. 2a and 2b; 
20 Fig. 4 is a diagram showing one example of a 

display on the CRT of Fig. 1; 

Fig. 5 is a detailed flowchart showing the 
first half of Step S81 of Fig. 2a; 

Fig. 6 is a detailed flowchart showing the 
25 second half of Step S81 of Fig. 2a; 

Fig. 7 is a diagram showing a principle view 
of the multi-valued image processing of Figs. 5 and 6; 
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Figs. 8a to 8c are diagrams showing the 
concept of shadow extraction; 

Fig. 9 is a detailed flowchart showing Step 
S83 of Fig. 2a; 

Fig. 10 is a flowchart showing details of the 
shadow extraction processing of Fig. 9; 

Fig. 11 is a flowchart showing details of the 
first to third decision processings of Steps S43, S45 
and S45 of Fig. 10; 

Fig. 12 is a flowchart showing details of 
decision making subroutines Al to A3 of Steps S72, S74 
and S75 of Fig. 11; 

Fig. 13a is a conceptual diagram showing the 
manner of imaginary loops set on a CT image, and Fig. 
13b is a graph showing pixel values of each of the 
imaginary loops in the processing of Fig. 12; 

Figs. 14a and 14b are a conceptual diagram 
showing a method of searching for a pixel whose density 
is to be found, spirally from the central position of a 
shadow; 

Figs. 15a and 15b are conceptual diagrams 
showing another method of searching for a pixel whose 
density is to be found, spirally from the central 
position of a shadow; 

Figs. 16(a-l), 16(a-2) through 16(c-l), 16(c- 
2) are conceptual diagrams of sampling points by each 
of the search methods of Figs. 15 and 16; 

Figs. 17a and 17b are conceptual diagrams of 



a method of converting the shape of a shadow in a 
multi-valued image into the degree of density; 

Fig. 18 is a graph showing a method of 
determining whether a shadow is a focus candidate 
shadow or a normal shadow; 

Fig. 19 is a diagram showing one example of a 
CT image in which a focus shadow and a normal shadow 
exist ; 

Figs. 20a and 20b, when combined, comprise a 
detailed flowchart of each of the decision making 
subroutines Bl to B3 of Steps S72, S74 and S75 of Fig. 
11; 

Fig. 21a is a conceptual diagram of the case 
of abnormal shadow, and Figr. 21b is a graph showing the 
pixel values in each of the decision making subroutines 
Bl to B3 of Figs. 20a and 20b; 

Fig. 22a is a conceptual diagram of the case 
of a blood vessel cross-sectional shadow, and Fig. 22b 
is a graph showing the pixel values in each of the 
decision making subroutines Bl to B3 of Figs. 20a and 
20b; 

Figs. 23a and 23b, when combined, comprise a 
detailed flowchart of each of the decision making 
subroutines CI to C3 of Steps S72, S74 and S76 of Fig. 
11; 

Fig. 24a is a conceptual diagram and Fig. 24b 
is a graph of the processing of the decision making 
subroutines CI to C3 of Fig. 23; 



Fig. 25 is a detailed flowchart of each of 
decision making subroutines Dl to D3 of Steps S72, S74 
and S76 of Fig. 11; 

Figs. 26a to 26d are conceptual diagrams of 
the processing of the decision making subroutines Dl to 
D3 of Fig. 25; 

Fig. 27 is a detailed flowchart of a decision 
making subroutine El of Step S72 of Fig. 11; 

Figs. 28a and 28b are conceptual diagrams of 
the processing of the decision making subroutine El of 
Fig. 27; 

Fig. 29 is a detailed flowchart of a decision 
making subroutine Fl of Step S72 of Fig. 11; 

Fig. 30a is a conceptual diagram and Fig. 30b 
is a graph of the processing of the decision making 
subroutine Fl of Fig. 29; 

Fig. 31 is an image processing flow diagram, 
representing a modification of Fig. 3, showing the case 
where a CT image and images being processed on a bit 
memory are displayed in a combined form; 

Fig. 32 is a diagram showing another example 
of extracting a normal shadow to be excluded from focus 
candidate shadows ; 

Fig. 33 is a diagram showing an example of 
the display of all images and focus candidate images in 
separate windows in a classified manner; 

Fig. 34 is a diagram showing one example of a 
picture for setting the parameters required for the 



processing of each of the decision making subroutines; 

Fig. 35 is a diagram showing an example in 
which a plurality of circles which enclose a plurality 
of focus candidate shadows are displayed in a CT image; 

Figs. 36a and 36b are diagrams conceptually 
showing a method of processing the plurality of circles 
shown in Fig. 35, and the drawing of circular arcs so 
that the circles do not overlap one another, 
respectively; 

Fig. 37 is a flowchart showing one example of 
the processing of drawing the circular arcs shown in 
Fig. 35; 

Fig. 38 is a diagram showing one example of a 
case where a detection result picture, in which a focus 
candidate shadow is indicated by a marker, and a 
magnified picture in which the portion of the marker is 
displayed on a magnified scale, are displayed in one 
picture at the same time; 

Fig. 39 is a diagram showing one example of a 
display picture in which images are displayed in the 
order of execution of extraction of focus candidate 
shadows; 

Figs. 40a and 40b are diagrams showing the 
state in which a CT image is divided into 16 parts in 
the horizontal and vertical directions, Fig. 40a being 
a view showing the case where the 16 parts are assigned 
numbers in order from top left to bottom left, and Fig. 
40b being a view showing the case where the 16 parts 



are assigned numbers in order from top left to top 
right ; 

Fig. 41 is a diagram showing one example of a 
display picture in which a focus candidate shadow is 
displayed in order from top left to bottom left; 

Fig. 42 is a diagram showing one example of a 
display picture in which a focus candidate shadow is 
displayed in order from top left to top right; 

Fig. 43 is a diagram showing the state in 
which a CT image is divided into 40 areas in the 
horizontal and vertical directions; 

Figs. 44a to 44c are diagrams showing a 
specific example in which, in the case where it is 
determined that a shadow is located on a wall portion, 
a decision is made as to whether the shadow is a focus 
candidate shadow, on the basis of the length of contact 
between the shadow and the wall portion; 

Figs. 45a to 45c comprise a diagram and 
graphs showing another embodiment of the decision 
making subroutine ; 

Figs. 46a to 46d are diagrams showing yet 
another embodiment of the decision making subroutine; 

Figs. 47a and 47b are conceptual diagrams of 
the state where, when a comparatively large focus 
candidate shadow and blood vessel shadows overlap one 
another, the blood vessel shadows are excluded by 
cutting; 

Fig. 48 is a flowchart showing details of the 
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blood vessel cutting processing of Figs. 47a and 47b; 

Fig. 49a is a diagram and Fig. 49b is a graph 
showing a specific example of setting a cutting length 
in Fig. 48; 

5 Figs. 50a and 50b are diagrams showing a 

first modification of the decision making subroutine; 

Fig. 51a is a table and Fig. 51b is a graph 
showing the result of counting; 

Fig. 52a is a diagram and Fig. 52b is a graph 
10 showing a modification of the decision making 
subroutine of Figs. 50a and 50b; 

Figs. 53a to 53c are diagrams showing the 
first half of a second modification of the decision 
making subroutine; 
15 Figs. 54a to 54c are diagrams showing the 

second half of the second modification of the decision 
making subroutine; 

Figs. 55a to 55c are diagrams showing a 
specific example of the case of identifying a cancer- 
20 accompanying shadow which accompanies a cancer; 

Fig. 56 is a flowchart showing details of 
cancer-accompanying object detection processing for 
detecting a cancer-accompanying shadow; 

Fig. 57 is a diagram showing one example of a 
25 display picture in which the cancer-accompanying shadow 
detected by the cancer-accompanying object detection 
processing of Fig. 56 is displayed in the state of 
overlapping a marker; 
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Fig. 58a is a diagram and Figs. 58b and 58c 
are graphs showing a third modification of the decision 
making subroutine; 

Figs. 59a to 59c are diagrams showing a 
5 modification of the decision making subroutine of Figs. 
58a to 58c; 

Figs. 60a and 60b are diagrams showing 
another modification of the decision making subroutine 
of Figs. 58a to 58c; 
10 Figs. 61a and 61b are diagrams showing 

another embodiment of a focus candidate shadow display 
in which an arbitrary shadow is displayed with a mouse 
pointer during the display of a focus candidate shadow; 

Fig. 62 is a flowchart showing details of the 
15 focus candidate shadow display processing of Figs. 61a 
and 61b; 

Figs. 63a and 63b are diagrams showing a 
fourth modification of the decision making subroutine; 

Figs. 64a and 64b are diagrams showing a 
20 specific manner in which needle- or line-shaped shadows 
called spicules are identified; 

Fig. 65 is a conceptual diagram of a 
processing method, showing a modification of each of 
the decision making subroutines of Figs. 27 and 29; 
25 Figs. 66a to 66f are diagrams showing a 

specific example of the processing method of Fig. 65; 

Figs. 67a to 67d are conceptual diagrams 
showing a fifth modification of the decision making 
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subroutine; 

Fig. 68 is a table showing the contents of a 
memory which stores data, such as position information 
relating to detected focus candidate shadows; 
5 Figs. 69a and 69b are diagrams showing a 

specific example in which focus candidate shadows 
photographed and extracted in the past are displayed 
together ; 

Figs. 70a and 70b are diagrams showing a 
10 modification of the manner of displaying a marker; 

Figs. 71a and 71b are diagrams showing a 
specific example of the case where a focus candidate 
shadow is simply displayed in the state of being 
enclosed with a marker, and a specific example of the 
15 case where a CT image in an area enclosed with a marker 
is displayed in an emphasized state, respectively; 

Fig. 72 is a flowchart showing a modification 
of a process where a CT image having an extracted focus 
candidate shadow and a CT image having no extracted 
20 focus candidate shadow are displayed in order as a 
kinematic image; 

Fig. 73 is a flowchart showing one example of 
the display processing of displaying the diagnosis 
result provided by the image diagnosis supporting 
25 device according to this invention; 

Figs. 74a to 74c are diagrams showing another 
example of the display processing of displaying the 
diagnosis result provided by the image diagnosis 



supporting device according to this invention; 

Fig. 75 is a flowchart showing a modification 
of a main flowchart of the abnormal candidate shadow 
detection processing of Fig. 9; 
5 Figs. 76a to 76d are diagrams showing a sixth 

modification of the decision making subroutine; 

Fig. 77a is a diagram showing the sixth 
modification of the decision making subroutine, and 
Fig. 77b is a diagram illustrating one example of how 
10 to extract a shadow which seems not to be a focus; 

Fig. 78 is a flowchart showing a modification 
of the display processing of displaying the diagnosis 
result provided by the image diagnosis supporting 
device according to this invention; 
15 Figs. 79a to 79c are diagrams showing one 

example of a display picture which accompanies the 
display processing of Fig. 78; 

Figs. 80a to 80c are diagrams showing a 
seventh modification of the decision making subroutine 
20 and showing one example of the case where the area 

ratio of the total area of the entire focus candidate 
shadow to the area of a concave portion formed in an 
edge portion of the shadow; 

Figs. 81a and 81b are diagrams showing a 
25 modification of the seventh modification of the 

decision making subroutine and showing one. example of 
the process of how to extract a bifurcation of a blood 
vessel shadow; 
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Fig. 82 is a flowchart showing the seventh 
modification of the decision making subroutine and a 
flowchart showing one example of procedures for the 
case of finding the area ratio of Figs. 80a to 80c; 
5 Fig. 83 is a diagram showing one example of a 

display picture which accompanies the processing of 
Figs. 80a to 80c; 

Figs. 84a and 84b are diagrams showing a 
modification of the method of finding the area ratio; 
10 Figs. 85a and 85b are diagrams showing a 

further modification of the method of finding the area 
ratio; 

Figs. 86a to 86c are diagrams showing one 
example of the case where a special shadow including a 
15 shadow of a pleural membrane is found; 

Fig. 87 is a view showing one example of CT 
images of image numbers 1 to N corresponding to results 
of abnormal candidate shadow extraction processing; 

Fig. 88 is a view showing one example of a 
20 display processing flow for fixing a display position 
of an area; 

Figs. 89a to 89c are views showing how the CT 
image of Fig. 87 is displayed by the display processing 
flow of Fig. 88; 
25 Fig. 90 is a view showing the record states 

of an abnormal candidate shadow image recorded in a 
magnetic disk and images of Nl to Nm determined to be 
abnormal by a doctor; 
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Figs. 91a to 91c are views showing one 
example where the CT image of Fig. 87 is shifted in 
parallel vertically and laterally so that a point of 
contemplation, i.e. a marker is positioned at two 
5 points in almost the center of the screen; 

Fig. 92 is a view showing one example where a 
marker indicating a shadow area of an abnormal 
candidate shadow image that is subsequently displayed; 

Fig. 93 is a view showing a processing flow 
10 where the marker of Fig. 92 is preliminarily displayed; 

Figs. 94a and 94b are views showing the case 
where when a part of test object in a CT image being 
displayed is clicked with a mouse cursor, CT images 
each having an abnormal candidate shadow near an arrow 
15 of a mouse cursor are selectively displayed in order 
together with circular markers; 

Fig. 95 is a view showing an abnormal 
candidate shadow retrieval and display processing flow 
in which abnormal candidate shadows each existing in a 
20 designated area are displayed in order; 

Figs. 96a and 96b are views showing one 
example of a method of identifying a designated area; 
and 

Figs. 97a and 97b are views showing one 
25 example in which a plurality of abnormal candidate 
shadow images are displayed at a time. 

DESCRIPTION OF THE EMBODIMENTS 
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Preferred embodiments of an image diagnosis 
supporting device according to this invention will be 
described with reference to the accompanying drawings. 

Fig. 1 is a block diagram showing the overall 
5 hardware construction of an image diagnosis supporting 
device to which this invention is applied. This image 
diagnosis supporting device displays extracted focus 
candidate shadows on the basis of a plurality of 
tomographic images (such as CT images) that are 

10 collected from a target area of a sample by means of, 
for example, an X-ray CT device. The image diagnosis 
supporting device selectively displays, in addition to 
focus candidate shadows, shadows of high certainty from 
among extracted focus candidate shadows or the like, or 

15 displays halfway images during this processing. 

This image diagnosis supporting device is 
made up of a central processing unit (CPU) 40 which 
controls the operation of each constituent element, a 
main memory 42 in which a control program for the 

20 device is stored, a magnetic disk unit 44 in which a 
plurality of tomographic image data and a computer 
program and the like are stored, a display memory 4 6 
which temporarily stores image data to be displayed, a 
CRT display 48 which serves as a display device to 

25 display an image on the basis of image data read out 
from this display memory 46, a mouse 50 for 
manipulating software switches on a screen, a 
controller 52 for the mouse 50, a keyboard 54 provided 



with keys and switches for setting various parameters, 
a speaker 58, and a common bus 56 which connects the 
above-described constituent elements to one another. 
The display is not limited to a CRT, but a various 
5 kinds of displays such as liquid crystal and plasma 
displays may be used. 

In the illustrated example, only the magnetic 
disk unit 44 is connected as a storage device other 
than the main memory unit 42, but in addition to this 

10 magnetic disk 44, a floppy disk drive, a hard disk 
drive, a CD-ROM drive, a magneto-optical disk (MO) 
drive, a ZIP drive, a PD drive, a DVD drive and the 
like may also be connected. Furthermore, the image 
diagnosis supporting device may also be connected to 

15 various communication networks, such as a LAN (local 

area network) , the Internet and a telephone. line via a 
communication interface which, is not shown, so that 
the image diagnosis supporting device can transmit and 
receive image data and program data to and from other 

20 computers. In addition, the inputting and outputting 
of image data may also be implemented in such a manner 
that a medical image diagnosis device, such as an X-ray 
CT device and an MRI device, capable of collecting 
tomographic images of samples, is connected to the 

25 above-described LAN and the like. 

An operational example of the image diagnosis 
supporting device shown in Fig. 1 will be described 
below with reference to the accompanying drawings. 
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Fig. 2 is a flowchart showing one example of a process 
to be executed by the image diagnosis supporting 
device. The CPU 4 0 shown in Fig. 1 operates in 
accordance with this main flowchart. Fig. 3 is a view 
5 showing how an CT image is processed according to this 
main flowchart. Fig. 4 is a view showing one example 
of a display picture on the CRT display 48. This main 
flowchart is activated when an operator inputs the name 
of a patient, who is a target of focus candidate 

10 extraction and display processing, in a field "Name of 
Patient" on the display picture shown in Fig. 4 and 
clicks a button "COMPUTE". Details of the processing 
indicated by this flowchart will be described below in 
the order of the steps thereof. In this specification, 

15 the shadow includes a normal shadow and an abnormal 
candidate shadow, and the abnormal candidate shadow 
includes a normal shadow and an abnormal shadow. In 
some cases, however, the abnormal shadow refers to an 
abnormal candidate shadow. 

20 [Step S80] The CPU 40 reads from the 

magnetic disk unit 44 a CT image 20 (Fig. 3 at (al) ) of 
the patient corresponding to the patient name shown in 
Fig. 4 from among CT images of the patient photographed 
by a CT device. 

25 [Step S81] The CPU 40 applies digitization 

processing to a diagnostic target organ in the read CT 
image, and generates a multi-valued image as shown in 
Fig. 3 at (bl) . Details of this digitization 
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processing will be described later. 

[Step S82] To execute optimum detection 
processing corresponding to the area of the diagnostic 
target organ or the kind of organ, the CPU 40 
5 determines the area or the kind of organ and makes a 
decision as to whether to proceed to Step S83 or Step 
S84 . 

[Step S83] The CPU 40 applies various kinds 
of image processing to the multi-valued image shown in 

10 Fig. 3 at (bl), selects a focus candidate shadow and 
detects a shadow inferred to be a focus candidate, 
i.e., an abnormal candidate shadow 22. This abnormal 
candidate shadow detection processing processing 
detects the abnormal candidate shadow 22 without using 

15 the original CT image, on the basis of only the multi- 
valued image generated in Step S81. Details of this 
will be described later. By implementing abnormal 
candidate shadow detection processing processing on the 
basis of a multi-valued image as in this embodiment, it 

20 is possible to shorten the time required for computer 
operations and the like, and it is also possible to 
ease the burden of computer processing. 

[Step S84] The CPU 40 applies various kinds 
of image processing to the CT image of Fig. 3 as seen 

25 at (al) and the multi-valued image of Fig. 3 as seen at 
(bl) , and selects a focus candidate shadow and detects 
a shadow inferred to be a focus candidate, i.e., an 
abnormal candidate shadow 22. 
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Incidentally, a decision-in-progress image 24 
indicative of the progress of the abnormal candidate 
shadow detection processing processing in each of Steps 
S83 and S84 is displayed in parallel form by the side 
5 of the CT image 20 of Fig. 3 as seen at (al) on the CRT 
display 48, as shown in Fig. 4. Incidentally, when the 
button "COMBINE" shown in Fig. 4 is clicked, the 
decision-in-progress image 24 is combined with the CT 
image 20 in response to the click, and the result is 

10 displayed. The displayed contents of the decision-in- 
progress image 24 are sequentially changed in 
accordance with the processing of data on the multi- 
valued image (i.e., according to the stage of 
extraction of a focus candidate shadow) . When the 

15 number of extracted abnormal candidate shadows which 
are detected through the abnormal candidate shadow 
detection processing processing is larger than a 
predetermined number, the CPU 40 may also provide a 
display indicative of decision disabled and bring the 

20 processing to an end. The result is constantly 
recorded on the magnetic disk. Details of this 
abnormal candidate shadow detection processing 
processing will be described later. 

[Step S85] The CPU 40 leaves as a focus 

25 portion a focus candidate which has been determined to 
be an abnormal candidate shadow in the above-described 
Step S83 or S84, or deletes a focus candidate which has 
not been so determined in the above-described Step S83 



or S84. 

[Step S86] The CPU 40 determines whether the 
three-dimensional image structuring button 3D shown in 
Fig. 4 has been clicked, i.e., whether the three- 
5 dimensional image structuring flag is "1" or "0", and 
proceeds to Step S87 in the case of "1" (yes) . In the 
case of "0" (no), the CPU 40 proceeds to Step S88. 
Incidentally, the three-dimensional image structuring 
flag can be set to "1" or "0" if the operator 

10 arbitrarily clicks the three-dimensional image 

structuring button of Fig. 4 as the occasion demands. 

[Step S87] The processing of Step S87 is 
executed in the .case where the decision made in Step 
S86 is yes. The CPU 40 starts structuring processing 

15 for a three-dimensional image from a plurality of CT 
images near the abnormal candidate shadow. The 
structuring processing for a three-dimensional image is 
executed in parallel with the processing of Step S88, 
but after the structuring processing for a three- 

20 dimensional image has been completed, the CPU 40 may 
also proceed to Step S88 to execute the processing of 
Step S88. 

[Step S88] In order to enable the abnormal 
candidate shadow to be easily identified, the CPU 40 
25 performs a combining processing to display the CT image 
of Fig. 3 as seen at (al) with color information added 
thereto, to display the abnormal candidate shadow 
enclosed with a marker M, or to display a colored 
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extracted focus portion or a marker in the original 
image (CT image). In Fig. 3 at (a2), there is 
displayed one example of a combined image in which the 
abnormal candidate shadow is enclosed with the marker 
5 M. 

[Step S89] The CPU 40 determines whether a 
multifunction image display button has been turned on, 
and if the button has been turned on (yes) , the CPU 40 
proceeds to Step S8A. If the button has not been 
10 turned on (no), the CPU 40 proceeds to Step S8B . 

[Step S8A] Since the multifunction image 
display button is in the "on" state, the CPU 40 
displays the three-dimensional image structured in Step 
S87 . 

15 [Step S8B] The CPU 40 determines whether an 

instruction to perform the same focus candidate 
extracting and displaying processing on an image of 
another patient has been given by the operator. If the 
CPU 40 determines that an image of another patient is 

20 to be displayed (yes), the CPU 40 returns to Step S80 
and repeatedly executes the same processing. If the 
CPU 4 0 determines that an image of another patient is 
not to be displayed (no) , the CPU 40 proceeds to Step 
S8C. 

25 [Step S8C] The CPU 40 determines whether the 

"END" button shown in Fig. 4 has been turned on by the 
operator. If the CPU 40 determines that the button has 
not been turned on (no) , the CPU 40 returns to Step S89 
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and continues normal image display or multifunction 
image display. If the CPU 40 determines that the 
button has been turned on (yes), the CPU 40 brings the 
processing to an end. 
5 The multi-valued image processing of Step S81 

of Fig. 2 is performed on the basis of the CT image 20 
shown in Fig. 3. This multi-valued image processing 
is, as shown in Fig. 3, intended to apply predetermined 
thresholding processing to a result obtained by 

10 calculating a standard deviation and the like of the 
original CT image 20 and produce a multi-valued image 
as shown in Fig. 3 at (al). Figs. 5 and 6 are 
flowcharts showing details of the multi-valued image 
processing for the diagnostic target organ in Step S81 

15 of Fig. 2. The most basic binary image processing in 
the multi-valued image processing will be described 
hereinbelow. Conventionally, a method of finding a 
difference between each CT image has been used as one 
of the image processing methods for emphasizing and 

20 displaying shadows. For example, the difference in CT 
value between pixels at the same address (x, y) is 
found between two adjacent CT images each having an 
image size of 512 x 512, and this difference in CT 
value is stored at the address (x, y) in the memory, 

25 whereby an emphasized image whose shadow is emphasized 
is obtained. There is also a method using standard 
deviation (inclusive of variance). These methods do 
not particularly emphasize the vicinity of the boundary 
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of a shadow, and they extract neither the boundary 
(edge) of a shadow, nor a shadow only. On the other 
hand, this embodiment extracts a shadow in a CT image 
(particularly, the vicinity of the boundary of the 
5 shadow) , or adopts multi-valued image processing, which 
enables an extracted shadow to be displayed with 
emphasis. Fig. 7 is a view for theoretically 
explaining this multi-valued image processing. Details 
of the processing indicated by this main flowchart will 

10 be described below in the order of the steps thereof. 

[Step Sll] The CPU 40 sets a particular area 
of predetermined shape to be the initial position on 
the CT image. For example, as shown in Fig. 7, the CPU 
40 sets particular areas (small areas) 12A and 12B each 

15 having a square shape of 10 x 10 pixels within the CT 
image 20 (a tomographic image of the sample) , and sets 
the areas 12A and 12B at an initial position at the top 
left corner of the CT image 20. If the coordinates of 
the central position of each of these small areas 12A 

20 and 12B are (X, Y) , the coordinates (X, Y) are 

respectively set to (0, 0) . Incidentally, in Fig. 7, 
the small area 12A is set inside a shadow 15, and the 
small area 12B is set to overlap the boundary (edge) of 
a shadow 16. Each of these small areas is not limited 

25 to a size of 10 x 10 pixels, and they may also have, 

for example, a rectangular shape, a diamond shape or a 
circular shape, other than a square shape. If the 
central position of such a small area differs from the 
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weighted center position of the same, the weighted 
center position is given priority, but either of the 
central position or the weighted center position may be 
selected for priority on a case-by-case basis. 
5 [Step S12] The CPU 40 finds an average value 

AV of the density value (CT value) of the small area. 
The obtained average value AV exhibits a high value if 
the small area exists in the shadow 15 like the small 
area 12A of Fig. 7 , a low value if the small area does 
10 not overlap a shadow, or an approximately middle value 
if the small area overlaps the shadow 16 like the small 
area 12B. 

[Step S13] The CPU 40 finds the average p 
(xp, yp) of the coordinate values of pixels whose 

15 density values are not smaller than the average density 
value AV within the small area, as well as an average m 
(xm, ym) of the coordinate values of pixels whose 
density values are smaller than the average density 
value AV. In the case of the small area 12A of Fig. 7, 

20 average values pA and mA are approximately near the 
center of the small area 12A, and the coordinate 
positions of both average values pA and mA 
approximately coincide with each other. On the other 
hand, in the case of the small area 12B, an average 

25 value pB is approximately near the center of the 

portion of the small area 12B that is superposed on the 
shadow 16, and an average value mB is approximately 
near the center of the portion of the small area 12B 
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that is not superposed on the shadow 16, and the 
coordinates of both average values pB and mB are 
removed from each other. 

[Step S14] The CPU 40 determines the 
5 distance D between the coordinates (xp, xy) of the 
average value p and the coordinates (xm, xm) of the 
average value m. In the case of the small area 12A of 
Fig. 7, since the average values pA and mA are the 
same, the distance D becomes "0". In the case of the 
10 small area 12B, since the average value pB and the 
average value mB are spaced from each other, the 
distance D becomes a corresponding distance DB. 
Namely, this distance D tends to be large in the case 
where the small area is located near the edge of the 
15 shadow, or to be small in the case where the small area 
does not overlap the shadow. 

[Step S15] To make the above-described 
tendency more remarkable, in this step S15, the CPU 40 
finds M = g-f(D) as a moment M at the central 
20 coordinates (X, Y) of the small area on the basis of 
the distance D found in Step S14 . This moment M is a 
value related to (X, Y) . For example, letting Np be 
the number of pixels whose density values are not 
smaller than the above-described average value AV 
25 within the small area, and letting Nm be the number of 
pixels whose density values are smaller than the 
average value AV, each of the moments Ml to M3 found on 
the basis of the following equations is defined as the 



moment M in Step S15: 

the moment Ml is Ml = Np x Nm x D; 
the moment M2 is M2 = Nor x D, 
(where Nor is the larger of Np and Nm) ; and 
the moment M3 is M3 = an existing variance x 

D, 

(where D may be the 5-th power of a value of 
about 1-3 . ) 

In general, a computation including D is 
effective. In addition, even in the decision 
processing which will be described later, a computation 
result including D relative to a focus area can be used 
for decision. 

[Step S16] The CPU 40 adds 1 to the central 
coordinate X of the small area in order to move the 
small area in the X direction of the image. 

[Step S17] The CPU 40 determines whether the 
value of the coordinate X of the center of the small 
area is a maximum (a position where the small area is 
moved beyond the right end of the image) , and if the 
CPU 40 determines that the value is a maximum (yes) , 
the CPU 40 proceeds to Step S17. If the CPU 40 
determines that the value is not a maximum (no) , the 
CPU 40 returns to Step S12, where the CPU 40 repeats 
the processing of Step S12 to Step S17 until the value 
of the central coordinate X becomes a maximum. 

[Step S18] Since it has been determined in 
the above-described step S17 that the central 



coordinate X of the small area is a maximum, the CPU 40 
returns the central coordinate X to an initial value 
(normally, "0" ) in order to return the small area to 
the left end of the image. 
5 [Step S19] The CPU 40 adds "1" to the 

central coordinate Y of the small area in order to move 
the small area in the Y direction of the image. 

[Step S20] The CPU 40 determines whether the 
value of the coordinate Y of the center of the small 

10 area is a maximum (a position where the small area is 
moved beyond the right end of the image), and if the 
CPU 40 determines that the value is a maximum (yes) , 
the CPU 40 brings the processing to an end, and 
proceeds to Step S21 of Fig. 6 via a connector A. If 

15 the CPU 40 determines that the value is not a maximum 
(no) , the CPU 40 returns to Step S12, where the CPU 40 
repeats the processing of Step S12 to Step S20 until Y 
becomes a maximum. In this manner, the CPU 40 scans 
the small area from the top left to the bottom right of 

20 the CT image 20 and sequentially calculates the moment 
M at the central coordinate position of the small area. 

A method of extracting pixels located in a 
shadow or near the boundary of the shadow from each CT 
image 20 by using the moment M obtained in this manner 

25 will be described below in accordance with the 
flowchart shown in Fig. 6. 

[Step S21] The CPU 40 reads a constant 
inputted from the keyboard by the operator, or a 
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constant stored in advance in the magnetic disk 44 or 
the like, as a threshold for determining whether each 
pixel of the CT image 20 is in a shadow or near the 
boundary of the shadow, and specifies the read constant 
5 as a constant. 

[Step S22] In order to set a pixel which is 
a decision target (a decision target pixel) in the 
initial position which is the top left corner of the CT 
image 20, the CPU 40 set the coordinates (X, Y) of the 
10 decision target pixel) to (0, 0). 

[Step S23] The CPU 40 reads the moment M 
obtained in Step S15 of Fig. 5 as to a small area 
centered about the coordinates (X, Y) of the decision 
target pixel. 

15 [Step S24] The CPU 40 determines whether the 

read moment M is larger than the constant specified in 
Step S21. If the CPU 40 determines that the read 
moment M is larger (yes), the CPU 40 proceeds to Step 
S25, whereas if the CPU 40 determines that the read 

20 moment M is not larger (no) , the CPU 40 jumps to Step 
S26. 

[Step S25] The fact that it has been 
determined in Step S24 that the moment M is larger than 
the constant means that the decision target pixel 
25 corresponding to the coordinates (X, Y) corresponds to 
the shadow or the boundary of the shadow. Accordingly, 
in this step, the CPU 40 extracts the coordinates (X, 
Y) and stores them in the memory (the main memory 42 or 
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the magnetic disk unit 44). Specifically, if the CPU 
40 has determined in Step S24 that the moment M is 
larger than the constant (yes), the CPU 40 sets a 
binary high level "1" to the coordinates (X, Y) . On 
5 the other hand, if the CPU 40 determines in Step S24 

that the moment M is not larger than the constant (no), 
the CPU 40 sets a binary low level "0" to the 
coordinates (X, Y) . In this manner, each set of 
coordinates is set to either of a low level "0" or a 

10 high level "1" and is binarized. By binarizing each 
set of coordinates in this manner, it is possible to 
express each set of coordinates by one bit, whereby it 
is possible to simplify the following processing. 

[Step S26] The CPU 40 adds "1" to the 

15 coordinate X in order to move the coordinates of the 
decision target pixel in the X direction. 

[Step S27] The CPU 40 determines whether the 
value of the coordinate X of the decision target pixel 
is a maximum (a position beyond the right end of the 

20 image) , and if the CPU 40 determines that the value is 
a maximum (yes), the CPU 40 proceeds to Step S28. If 
the CPU 40 determines that the value is not a maximum 
(no), the CPU 40 returns to Step S23, where the CPU 40 
repeats the processing of Step S233 to Step S26 until X 

25 becomes a maximum. 

[Step S28] Since the CPU 40 has determined 
in the above-described step S27 that the coordinate X 
of the decision target pixel is a maximum, the CPU 40 



resets the coordinate X to f, 0 M in order to return the 
decision target pixel to the left end, and adds "1" to 
the coordinate Y of the decision target pixel in order 
to move the decision target pixel in the Y direction. 
5 [Step S29] The CPU 40 determines whether the 

coordinate Y of the decision target pixel is a maximum 
(a position beyond the bottom end of the image) , and if 
the CPU 40 determines that the value is a maximum 
(yes) , the CPU 40 brings the processing to an end. If 

10 the CPU 40 determines that the value is not a maximum 
(no), the CPU 40 returns to Step S23, where the CPU 40 
repeats the processing of Step S23 to Step S28 until Y 
becomes a maximum . 

In this manner, the CPU 40 scans the decision 

15 target pixel from the top left to the bottom right of 
the CT image 20 and makes a decision as to whether the 
decision target pixel corresponds to the shadow or the 
boundary of the shadow. Through the above-described 
processing, the central point (X, Y) of the small area 

20 having the moment M larger than the constant, i.e., the 
coordinate point of the pixel lying in the shadow or 
the boundary of the shadow, is sequentially stored in 
the memory (the main memory 42 or the magnetic disk 
unit 44). Incidentally, in the description of Figs. 5 

25 and 6, reference has been made to binarization using a 
low level "0" and a high level "1", but the CT image 20 
can be digitized with an arbitrary number of values by 
specifying a plurality of constants in Step S21. For 
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example, it is possible to digitize the CT image with 
four values by specifying three constants CI, C2 and C3 
and determining to which of the following cases the 
moment M corresponds: the case where the moment M is 
5 smaller than the constant CI, the case where the moment 
M is not smaller than the constant CI and is smaller 
than the constant- C2, the case where the moment M is 
not smaller than the constant C2 and is larger than the 
constant C3, and the case where the moment M is not 

10 smaller than the constant C3. In the case of four- 
value digitization, one pixel is expressed by two bits. 
Incidentally, if the CT image is to be digitized with 
yet another number of values, a plurality of constants 
may be similarly specified so that the CT image can be 

15 digitized on the basis of the constants. 

Figs. 8a to 8c show the concept of how a 
shadow is extracted by the above-described method of 
extracting a pixel located in a shadow or near the 
boundary of the shadow. When the above-described 

20 processing is executed on a CT image 21 having a 

circular shadow which, as shown in Fig. 8a, exhibits 
the highest CT value near the center of the shadow and 
gradually decreases in CT value in the radius 
direction, a shadow 22 of a multi-valued image, the 

25 boundary of which is clear, as shown in Fig. 8b, is 

stored in the memory and is also displayed on the CRT 
display 48. In addition, by increasing the constant to 
be specified in Step S21, a ring-shaped shadow in which 
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a boundary 23 of the shadow is emphasized, as shown in 
Fig. 8c is extracted. Accordingly, by variously 
changing the constant to be specified in Step S21, it 
is possible to extract only the boundary of the shadow 
5 or to extract the entire shadow. In addition, the 

boundary, etc., of the shadow extracted in this manner 
can also be displayed with emphasis. 

The abnormal candidate shadow detection 
processing of Step S83 of Fig. 2a is performed by using 

10 the multi-valued image generated by the above-described 
multi-valued image processing. In addition, the 
abnormal candidate shadow detection processing of Step 
S84 of Fig. 2a is performed by using this multi-valued 
image and the CT image 20, which is the original image. 

15 In the case where abnormal candidate shadow detection 
processing is performed by using a multi-valued image 
like that used in Step S83, it is desirable to perform 
the abnormal candidate shadow detection processing by 
using a binary image and a multi-valued image digitized 

20 with a larger number of values (for example, an eight- 
valued image or a sixteen-valued image) . In the 
following description, reference will be made to a case 
where abnormality detection processing is performed by 
using a binary image and the CT image 20. 

25 Incidentally, in the case where the abnormal candidate 
shadow detection processing is to be performed by using 
only a multi-valued image like in Step S83 of Fig. 2a, 
it is similarly possible to cope with the abnormal 
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candidate shadow detection processing by reading the CT 
image 20 as the multi-valued image. 

Fig. 9 is a view showing the main flowchart 
of the abnormal candidate shadow detection processing. 
5 The abnormal candidate shadow detection processing of 
Fig. 9 extracts only pixels belonging to the range of 
predetermined CT values (pixel values) from a medical 
image and generates a medical image for a decision 
target, according to a parameter indicative of the kind 

10 of shadow, such as a small shadow, a large shadow, a 

ground glass opacity or a high-density shadow. Namely, 
there are kinds of shadows, such as a small shadow, a 
large shadow, a ground glass opacity and a high-density 
shadow. It is empirically confirmed that each of the 

15 shadows distinctively appears in a predetermined pixel 
value range within a medical image. For example, small 
shadows and large shadows remarkably appear in the 
range of pixel values (CT values) from -800 to 0, 
ground glass opacities in the range of from -800 . to - 

20 400, and high-density shadows in the range of from -400 
to 0. Accordingly, in this embodiment, only pixels 
belonging to a predetermined range of pixel values are 
extracted from a medical image according to the kind of 
shadow, a new target medical image is generated, and 

25 extracting processing for a focus candidate shadow is 

performed on the basis of the new target medical image. 
In addition, in the case of ground glass opacities, 
since a focus occurs in many cases in the periphery of 
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a lung region, it is effective to perform separate 
processing methods on a central portion and on a 
peripheral portion . 

Small shadow detection processing performs 
5 abnormal candidate shadow detection processing on a 
shadow in a decision target medical image made up of 
pixels which belong to the range of CT values from -800 
to 0 within the CT image 20. Large shadow detection 
processing performs abnormal candidate shadow detection 

10 processing on a shadow in a decision target medical 

image made up of pixels which belong to the range of CT 
values from -800 to 0. Glass-shaped shadow detection 
processing performs abnormal candidate shadow detection 
processing on a shadow in a decision target medical 

15 image made up of pixels which belong to the range of CT 
values from -800 to -400. High-density shadow 
detection processing performs abnormal candidate shadow 
detection processing on a shadow in a decision target 
medical image made up of pixels which belong to the 

20 range of CT values from -400 to 0. Incidentally, the 

multi-valued image extracting processing of Step S81 of 
Fig. 2a may be performed on the basis of this target 
medical image, so that the abnormal candidate shadow 
detection processing of Step S83 and Step S84 of Fig. 

25 2a is performed by using the obtained multi-valued 

image. Accordingly, in the following description, the 
term "CT image" includes this target medical image and 
a multi-valued image, and the terms "pixel value" and 
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"density value" include pixel values in a multi-valued 
image . 

Fig. 10 is a view showing details of each of 
these types of shadow detection processing. The types 
5 of shadow processing executed in the abnormal candidate 
shadow detection processing shown in Fig. 9 are 
approximately common to one another except that 
predetermined values Ra and Rb used in Steps S41, S44 
and S4 6 differ among the types of shadow processing. 

10 The size of a shadow is expressed by the number of 
pixels which constitute the shadow. There exist 
various focus shadows of different sizes, such as small 
shadows, large shadows, ground glass opacitys or high- 
density shadows. In the case where decision processing 

15 is performed on these shadows, similar processing is 
executed on each of the shadows by using a parameter 
corresponding to the size of each of the shadows. 
However, in the case where a shadow itself is small or 
large, or where shadows appear at different locations, 

20 there occurs the problem that if the same decision 

processing is performed with the same parameter, the 
accuracy becomes lower. Therefore, it is necessary to 
increase or decrease a parameter according to the size 
of each shadow. In this embodiment, if a shadow is 

25 smaller than the predetermined value Ra, the image of 
the shadow is enlarged; whereas, if a shadow is larger 
than the predetermined value Rb, the image of the 
shadow is reduced, whereby the image of the shadow is 
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converted into a shadow having a size which enables 
decision processing to be most efficiently performed on 
the shadow, and the decision processing is performed on 
the converted shadow. Details of this shadow detection 
5 processing will be described below, step by step. 

[Step S41] The CPU 40 determines whether the 
size (in this case, the number of pixels) of a shadow, 
which constitutes a detection target, is smaller than 
the predetermined value Ra; and, if the CPU 40 

10 determines that the size of the shadow is smaller 

(yes), the CPU 40 proceeds to Step S42; whereas, if the 
CPU 40 determines that the size of the shadow is not 
smaller (yes), the CPU 40 jumps to Step S44. 

[Step S42] Since it has been determined in 

15 Step S41 that the size of the shadow is smaller, the 
CPU 40 enlarges the shadow image to a size 
corresponding to a parameter to- be used in the first 
decision processing of Step S43. In this case, the 
pixel value between each pixel is determined by 

20 interpolation processing. 

[Step S43] The CPU 40 executes the first 
decision processing on the shadow that was enlarged in 
Step S42. 

[Step S44] The CPU 40 determines whether the 
25 size of the shadow, which constitutes a decision 

target, is not smaller than the predetermined value Ra 
and not larger than the predetermined value Rb or more, 
i.e., whether the size of the shadow is within a 
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predetermined range. If the CPU 40 determines that the 
size of the shadow is within the predetermined range 
(yes), the CPU 40 proceeds to Step S45; whereas, if the 
CPU 40 determines that the size of the shadow is not 
5 within the predetermined range (no) , the CPU 40 jumps 
to Step S46. 

[Step S45] The CPU 40 executes second 
decision processing on the shadow whose size is within 
the predetermined range of Step S44. 
10 [Step S46] The CPU 40 determines whether the 

size of the shadow extracted according to each CT value 
is larger than the predetermined value Rb; and, if the 
CPU 40 determines that the size of the shadow is larger 
(yes), the CPU 40 proceeds to Step S47; whereas, if the 
15 CPU 40 determines that the size of the shadow is not 

larger (no) , the CPU 40 brings the processing to an end 
and proceeds to the next shadow decision processing 
shown in Fig, 9. 

[Step S47] Since the CPU 40 determines in 
20 Step S46 that the size of the shadow is larger than the 
predetermined value Rb, the CPU 40 reduces the image of 
the shadow to a size corresponding to a parameter to be 
used in the third decision processing of Step S48. 

[Step S48] The CPU 40 executes the third 
25 decision processing on the shadow that has been reduced 
in Step S47, and then proceeds to the shadow decision 
processing shown in Fig. 9 ( large-shadow detection 
processing, ground glass opacity detection processing 
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or high-density shadow detection processing) . 
Incidentally, although the number of pixels are used as 
the size of the shadow, the maximum diameter or the 
minimum diameter of the shadow may also be used. In 
5 this case, it is preferable to set a minimum diameter 
of about 7 mm to the predetermined value Ra and a 
maximum diameter of about 21 mm to the predetermined 
value Rb. 

Fig. 11 is a flowchart showing details of the 

10 first to third decision processing of Steps S43, S45 
and S48 of Fig. 10. The first to third decision 
processing are approximately common to one another 
except that various different parameters are used in 
the respective decision making subroutines of Steps 

15 S72, S74 and S76. The first decision processing is 
executed on an image which has been enlarged by Step 
S42 of the shadow decision processing shown in Fig. 10. 
The second decision processing is executed on an image 
whose shadow size has been determined as accommodated 

20 within a predetermined range, by Step S44 of the shadow 
decision processing shown in Fig. 10. The third 
decision processing is executed on an image which has 
been reduced by Step S47 of the shadow decision 
processing shown in Fig. 10. In each of the first to 

25 third decision processing, a combination of decision 
making subroutines is changed according to the slice 
thickness of each CT image. 

In a medical image, a shadow such as a 



cancer, a blood vessel, a cross section of a blood 
vessel, a cross section of a bronchus and the like are 
photographed together. As the slice thickness of a 
medical image is made different, a particular shadow of 
5 the shadows contained in the medical image becomes 

clear or obscure. For example, if the slice thickness 
is small, a shadow corresponding to a blood vessel 
extremely diminishes and becomes difficult to 
recognize. As the slice thickness increases, the 

10 shadow of the blood vessel clearly appears. 

Accordingly, in the case where the slice thickness is 
small, it is necessary to make a decision as to whether 
the shadow is a blood vessel shadow or a focus 
candidate shadow. Contrarily, in the case where the 

15 slice thickness is large, it is possible to clearly 

identify the shadow of a blood vessel, so that decision 
processing is not needed. In addition, in the case 
where a shadow is bound to a lung wall, as shown in 
Fig. 44, it is desirable to change processing according 

20 to the location where the shadow is present. 

Thus, processing is performed with a 
plurality of specialized decision making subroutines, 
and, finally, .a logical OR operation is carried out 
with respect to all the subroutine results. This 

25 embodiment is provided with first combined processing 
including decision processing El and E2 necessary for 
shadow decision in the case of a small slice thickness, 
as well as second and third combined processing, not 
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including the decision processing El and E2 . One of 
these first to third processes are appropriately 
selected according to slice thicknesses Sa and Sb. 
Details of the first to third decision processing will 
5 be described below in the order of the steps thereof. 

[Step S71] The CPU 40 determines whether the 
slice thickness of the CT image 20 is larger than the 
predetermined value Sa (for example, 10 mm) . If the 
CPU 40 determines that the slice thickness is larger 
10 (yes), the CPU 40 proceeds to the next step S72, 
whereas if the CPU 40 determines that the slice 
thickness is not larger (no) , the CPU 40 jumps to Step 
S73. 

[Step S72] The CPU 40 executes the first 
15 combined processing, combining decision making 
subroutines Al to Fl . 

[Step S73] The CPU 40 determines whether the 
slice thickness of the CT image 20 is not larger than 
the predetermined value Sa and not smaller than the 
20 predetermined value Sb, i.e., within a predetermined 
range. If the CPU 40 determines that the slice 
thickness is within the predetermined range (yes) , the 
CPU 40 proceeds to Step S74; whereas, if the CPU 40 
determines that the slice thickness is not within the 
25 predetermined range (no), the CPU 40 jumps to Step S75. 

[Step S74] The CPU 40 executes the second 
combined processing made up of a combination of the 
decision making subroutines A2 to D2 . In this second 
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combined processing, decision making subroutines 
corresponding to the decision making subroutines El and 
Fl are not executed. The decision making subroutines 
El and Fl constitute processing for determining whether 
5 a shadow is a shadow corresponding to a blood vessel; 
and, in the case of small slick thickness, a shadow 
corresponding to a blood vessel diminishes greatly and 
the decision making subroutines El and Fl are unable to 
recognize such shadows. Accordingly, in this step, the 

10. decision making subroutines are not executed. 

Incidentally, it goes without saying that the CPU 40 
may execute the decision making subroutines E2 and F2 
similarly to Step S72. 

[Step S75] The CPU 40 determines whether the 

15 slice thickness of the CT image 20 is smaller than the 
predetermined value Sb. If the CPU 40 determines that 
the slice thickness is smaller (yes) , the CPU 40 
proceeds to the next step S76; whereas, if the CPU 40 
determines that the slice thickness is not smaller 

20 (no) , the CPU 40 brings the processing to an end and 
proceeds to Step S44 or S46 of Fig. 10. 

[Step S76] The CPU 40 executes the third 
combined processing made up of a combination of 
decision making subroutines A3 to D3 . In this third 

25 combined processing, decision making subroutines 

corresponding to the decision making subroutines El and 
Fl are not executed. Similarly to the case of the 
above-described step, since the decision making 
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subroutines El and Fl constitute processing for 
determining whether a shadow. is a shadow corresponding 
to a blood vessel, decision making subroutines related 
to the decision making subroutines El and Fl are not 
5 executed. Incidentally, it goes without saying that 
the CPU 40 may execute the decision making subroutines 
E3 and F3 similarly to the case of Step S72. 

The respective decision making subroutines Al 
to A3 that are executed in Steps S72, S74 and S76 of 

10 Fig. 11 will be described below. Fig. 12 is a 

flowchart showing details of each of the decision 
making subroutines Al to A3. Figs. 13a and 13b are 
provided to conceptually show the manner of processing 
each of these decision making subroutines Al to A3, in 

15 which Fig. 13a is a diagram showing the manner in which 
imaginary loops are set on a CT image, while Fig. 13b 
is a graph showing the pixel values of each of the 
imaginary loops. In general, although there are some 
exceptions, the correlation of densities of a shadow 

20 located on a loop of radius r from the central position 
of the shadow exhibits a tendency to become larger in a 
focus shadow than in a blood vessel cross-sectional 
shadow. To use this tendency in shadow decision 
processing, the correlation of density variations of a 

25 shadow between adjacent loops spaced a small radius dr 
apart from each other is found. Namely, it is known 
that the density of a shadow greatly differs between 
the vicinity of the center of the shadow and the 



vicinity of the periphery thereof, so that if the 
correlation of density values only between adjacent 
loops is found, it is impossible to find an accurate 
correlation between both. In this embodiment , the 
5 correlation of density variations of the shadow is 
found. Incidentally, the vicinity of the central 
position of the shadow is determined on the basis of 
the multi-valued image (bl) of Fig. 3, and the 
determined center of the shadow is applied to the CT 

10 image 20 of Fig. 3, as seen at (al), and then the 

density on each loop is found. Incidentally, in the 
case of the Step S83 of Fig. 2a, multi-valued 
information indicative of a multi-valued image other 
than a binary image is used in place of the CT image 

15 20. Details of these decision making subroutines Al to 
A3 will be described below in the order of the steps 
thereof . 

[Step SI] The CPU 40 sets a radius r at 

which to search a shadow, as an initial value. In Fig. 
20 13a, for example, a value equivalent to about 1.5 times 

a square-shaped small area of approximately 10 x 10 

pixels is set as the radius r. 

[Step S2] The CPU 40 rotates at the radius r 

by one degree at one time about the vicinity of the 
25 center of the shadow, and it samples and records each 

pixel value in the range of angles 9 = 0 to 360 degrees. 

Incidentally, it is preferable to add a constant value 

for each loop in order to equalize the density average 
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of each loop. 

[Step S3] The CPU 40 sets a radius r + d 
obtained by adding the radius r to the small radius dr, 
to obtain the radius r of the next loop. In Fig. 13a, 
5 for example, a value equivalent to about 1.2 times the 
above-described small area is set as the small radius 
dr. 

[Step S4] The CPU 40 determines whether the 
radius r is a maximum, and, if the radius r is not a 

10 maximum (no), the CPU 40 jumps to Step S2; whereas, if 
the radius r is a maximum (yes), the CPU 40 proceeds to 
Step S5. Incidentally, the maximum radius is a radius 
which is set in advance according to, for example, the 
size of a focus target to be extracted and the kinds of 

15 first to third decision processing. 

[Step S5] The CPU 40 performs a computation 
based on a predetermined decision formula. For 
example, as shown in Fig. 13a, the CPU 40 determines 
the density differences between pixels at a point P (r, 

20 9) and pixels at a point P 1 (r 1 , 0) in the range of 0 to 
360 degrees, and determines the sum of the absolute 
values of the density differences. Namely, the CPU 40 
finds the correlation of densities between adjacent 
loops on the basis of the following formula (1): 



25 E| density difference between pixels at the 

same angle on adjacent loops I ... (1) 
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As described above, the correlation of 
shadows between adjacent loops is larger in a focus 
shadow than in a blood vessel cross-sectional shadow, 
so that the computation result of the above formula (1) 
5 tends to be smaller in a focus shadow than in a blood 
vessel . cross-sectional shadow. This fact can also 
clearly understood from each curve shown in Fig. 13b. 
Specifically, the curve (solid line) of a loop = 1 and 
the curve (dotted line) of a loop = 2 show similar 

10 density variations, and, therefore, it can be said that 
the correlation therebetween is extremely large. On 
the other hand, the curve (dotted line) of the loop = 2 
and the curve (dot-dashed line) of a loop = 3 show 
utterly different density variations, and therefore, it 

15 can be said that the correlation therebetween is small. 
Incidentally,, the computing formula for finding the 
correlation between adjacent loops is not limited to 
the above-described formula (1). 

On the other hand, although there are some 

20 exceptions, the magnitude of a shadow variation in the 
same loop is smaller in a focus shadow than in a blood 
vessel cross-sectional shadow. To use this fact in 
shadow a decision, as shown in Fig. 13a, the CPU 40 
determines the density differences between pixels at 

25 the point P (r, 9) and pixels at a point P" (r, 0") in 
the range of 0 to 360 degrees, and determines the sum 
of the absolute values of the density differences. 
Namely, the CPU 40 finds the correlation of densities 
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between adjacent pixels on the same loop on the basis 
of the following formula (2) : 



exceptions, the magnitude of a shadow variation in the 
same loop is smaller in a focus shadow than in a blood 
vessel cross-sectional shadow, so that the computation 
result of the above formula (2) tends to be smaller in 

10 a focus shadow than in a blood vessel cross-sectional 
shadow. This fact can also clearly understood from 
each curve shown in Fig. 13b. Namely, it can be said 
that the curve (solid line) of the loop = 1 and the 
curve (dotted line) of the loop = 2 show small density 

15 variations, whereas the curve (dot-dashed line) of the 
loop = 3 shows large density variations. Incidentally, 
a computing formula for finding the correlation between 
adjacent pixels on the same loop is not limited to the 
above-described formula (2). 

20 In this embodiment, the following formula 

(3), made up of a combination of the above formula (1) 
and the above formula (2), is used: 



S| density difference between adjacent pixels 



on the same loop I 



(2) 



5 



As described above, although there are some 



N 359 359 



Yl (constant x £|A^£|B|) , 



(3) 




where A: density difference between pixels at 
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the same angle on adjacent loops i and i + 1; and 

B: density difference between adjacent pixels 
on the same loop i. 

The computation result of this formula (3) 
5 shows a tendency for a focus shadow to be smaller than 
a blood vessel cross-sectional shadow. Accordingly, it 
is possible to make a decision to exclude from focus 
candidates a shadow whose computation result obtained 
from the formula (3) is larger than a constant value. 

10 Incidentally, a threshold to discriminate between a 
focus candidate shadow and a normal shadow (the 
constant of the formula (3) ) is experimentally found, 
and the threshold is previously recorded in the 
magnetic disk unit 44 and the like and is used when 

15 necessary by being read therefrom. 

Although in the formula (3) , summation is 
found after the absolute values have been found, the 
following decision formula (4) of finding the absolute 
values after having performed the summation may also be 

20 used: 



Y\ (constant x 



i = l 



359 




359 






0 


• 


0 


) . 


... (4) 



[Step S6] The CPU 40 determines whether the 
computation result obtained from the decision formula 
(3) or (4) is larger than a constant value. If the CPU 
25 40 determines that the computation result is larger 

(yes), the CPU 40 proceeds to Step S7; whereas, if the 
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CPU 40 determines that the computation result is not 
larger (no) , the CPU 40 brings the processing to an end 
and proceeds to the next subroutines Bl to B3 . 

[Step S7] The CPU 40 excludes from focus 
5 candidate shadows the result of the decision in Step 
S6, i.e., a shadow whose computation result obtained 
from the decision formula (3) or (4) is determined to 
be larger than the constant value (computation result > 
constant value) , and proceeds to the next subroutines 
10 Bl to B3. 

In the above description of the decision 
making subroutines Al to A3, reference has been made to 
the case where the center of a shadow is determined on 
the basis of the multi-valued (binary) image (bl) shown 

15 in Fig. 3 and the center of the shadow is applied to 
the CT image 20, thereby finding densities on a 
plurality of concentric loops about the center to make 
a decision as to whether the shadow is a focus 
candidate shadow. This decision method is merely one 

20 example, and various other modifications are available. 
Some modifications will be described below. 

Figs. 14a, 14b and 15a, 15b are views showing 
the concepts of several methods for searching for a 
pixel whose density is to be found, spirally from the 

25 central position of a shadow. As shown in Fig. 14a, a 
corresponding pixel for finding the density of a shadow 
is identified by selecting the vicinity of the center 
of a shadow 2 as a reference point and making a spiral 



search along loops LI, L2 and L3, which rotate 
clockwise from the reference point toward the edge of 
the shadow 2. Namely, the CPU 40 makes a search in the 
order indicated by solid-line arrows along the first 
5 loop LI; then it makes search in the order indicated by 
dotted-line arrows along the second loop L2; and 
subsequently it makes search in a similar manner along 
the third loop L3 and the following loops (not shown) , 
thereby identifying the corresponding pixel. 

10 incidentally, the starting point of the search and the 
direction of the search are not limited; and, as shown 
in Fig. 14b, a search may be concentrically made along 
the loops LI, L2 and L3 from the edge of the shadow 2 
toward the vicinity of the center of the shadow 2. In 

15 addition, the search order of one loop is not limited; 
and, as shown in Fig. 15a, as to the loop L2, a search 
may also be made in the order of Df -> Ff — > Fb — > Db 
and then in the order of Cf ^ Bf Bb — > Cb . 
Incidentally, the capital alphabetical letters 

20 indicative of the above-described search order indicate 
the y coordinate of the CT image 20, and the small 
alphabetical letters indicate the x coordinate of the 
same. Furthermore, as shown in Fig. 15b, while a 
radius is rotationally continuously increased, passage 

25 points may also be used as search point pixels. 

Figs. 16(a-l) to 16(c-2) conceptually show 
sampling points in the search methods shown in Figs. 
14a, 14b and 15a, 15b, show data at the sampling points 



in the pattern of values "0" and "1". Specifically, in 
each of Figs. 16(a-l) to 16(c-l), black dots indicate 
sampling points in each of shadows 3-5, respectively. 
Incidentally, the shadows 3-5 correspond to an binary 
5 image of Fig. 16{b-l), and any pixel value on each of 
the shadows is "1" and the other pixel values are "0". 
Numbers attached to the black dots indicate the order 
of search. The density values of the pixels on the 
shadows 3-5 that are sampled in accordance with this 

10 search order are shown as graphs in Figs. 16(a-2) to 

16{c-2). As is apparent from Figs. 16(a-2) to 16(c-2), 
the density value of each of the sampling points 
assumes a pattern made of "0" and "1". The CPU 40 
makes a decision as to whether the shadow is a focus 

15 candidate shadow, on the basis of this pattern. For 
example, if the state in which the density value at 
each sampling point is "1" continuously exists from 1 
to 9, as shown in Fig. 16(a-l), the shadow is 
determined as a focus candidate shadow. If, as shown 

20 in Fig. 16(b-2), the state in which the density value 
at each sampling point is "1" continuously exists from 
1 to 8 and the state in which the density value at each 
sampling point is "0" continues from 9 to 13, the 
shadow is determined as not being a focus candidate 

25 shadow. If, as shown in Fig. 16(c-2), the state in 

which the density value is "1" and the state in which 
the density value is "0" are repeated at short cycles, 
the shadow is determined as not being a focus candidate 
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shadow. Incidentally, it is preferable to make this 
decision with values previously learned on the basis of 
actual focus shadows. 

A method of converting the shape of a shadow 
5 in a multi-valued image into the degree of density 
shall here be explained. Figs. 17a and 17b are 
diagrams showing the concept of this converting method. 
As shown in Fig. 17a, when the case where a point 10 is 
selected as the starting point of a search is compared 

10 with the case where a point 12 is selected as the 

starting point of a search, the number of loop turns 
required to search for a point indicative of a pixel 
value of zero is larger in the case where the point 12 
is selected as the starting point of the search. 

15 Accordingly, by selecting a value proportional to this 
number of loop turns as the density of the shadow, it 
is possible to convert the shadow shape of the multi- 
valued image into density values. Incidentally, in the 
above-described embodiment, the weighted center portion 

20 of a shadow is adopted as the starting point of a 

search (the center of the shadow) , but as shown in Fig. 
17b, an intersection point 14 of a curve connecting 
dots (the circular dots shown in Fig. 17b) indicating 
the center of the vertical length lines of a shadow and 

25 a curve connecting dots (the triangular dots shown in 
Fig. 17b) indicating the center of the horizontal 
length lines of a shadow can also be selected as the 
center of the shadow. The starting point of a search 



may also be the center of a circle inscribed in a 
shadow in addition to the weighted center position of 
the shadow. In other words, the starting point of a 
search needs only to be near the center of the shadow. 
5 Each of the decision making subroutines may also be 
executed on the basis of densities converted in this 
manner . 

In addition, since the surroundings of an 
area to be extracted can be viewed, the above-described 

10 method can also be used to make a decision as to 
whether an area to take a value larger than a 
particular CT value surrounds the area to be extracted. 

Fig. 18 is a view showing a method of 
determining whether a shadow is a focus candidate 

15 shadow (cancer shadow) or a normal shadow. In the 

graph shown in Fig. 18, the horizontal axis represents 
the number of loop turns by which a search is made 
spirally or concentrically, while the vertical axis 
represents the average value of the densities at 

20 sampling points in each loop. The average value of 

densities is found on the basis of a multi-valued image 
as shown in Figs. 16(a-l) to 16(c-l). Incidentally, 
such average value may also be found on the basis of 
the original CT image and be normalized. In general, 

25 the density of a shadow tends to be high near the 

center of the shadow and to become lower toward the 
periphery thereof. Accordingly, as shown in Fig. 18, 
as the number of loop turns increases like points nl, 



n2, n3, n4 . .., or points Nl, N2, N3, N4 . .., the 
average of densities shows a tendency to decrease 
gradually. Incidentally, in Fig. 18, a curve 16 
represented by the points nl, n2, n3, n4 ... relates to 
5 a cancer shadow, while a curve 18 represented by the 
points Nl, N2, N3, N4 ... relates to a blood vessel 
cross-sectional shadow. As is apparent from this 
figure, the cancer shadow 16, which is a focus 
candidate shadow, is smaller than the blood vessel 

10 cross-sectional shadow 18 in the rate of diminishing as 
the number of the loop is higher. Accordingly, a 
multiplicity of curve data are measured by using actual 
cancer shadows in advance, and the measured results are 
stored in the magnetic disk unit or the like as 

15 reference data in advance, and a decision is made as to 
whether each shadow is a focus candidate shadow, on the 
basis of these reference data. 

Fig. 19 is a view showing one example of a CT 
image in which a focus shadow and a normal shadow 

20 exist. In the case where the CPU 40 is to discriminate 
between shadows 16a, 18a and 18b, as shown in Fig. 19, 
the CPU 40 makes a search spirally from the vicinity of 
the center of each of the shadows 16a, 18a and 18b and 
finds an average density value for each loop. The CPU 

25 40 compares each data on the average density value with 
each reference data of Fig. 18, and makes a decision as 
to whether the average density value coincides with any 
one of the reference data. For example, in the case 
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where the data of the average density value of the 
shadow 16 coincides with the curve 16 of Fig. 18, the 
shadow 16 is presented to a doctor as a candidate for a 
cancer shadow. The data of the average density value 
5 of each of the shadows 18a and 18b approximately 

coincides with the curve 18 of Fig. 18, but does not 
coincide with any of the reference data. In this case, 
the shadows 18a and 18b are deleted from focus 
candidate shadows, and are not presented to the doctor. 
10 Incidentally, the following formula (5) is used to make 
a decision as to whether the data of the average 
density data coincides with the reference data: 

y^|Ni-ni| < constant value . . . . ( 5 ) 

When the above formula (5) is satisfied, the 
15 two curves are regarded as coincident with each other. 
In the formula (5) , Ni is an average density value as 
to actually searched sampling points of a loop number 
i, and ni is an average density value (reference data) 
in a cancer shadow of the loop number i. The above 
20 absolute value may also be raised to the 5-th power (5 = 
1 to 2). Incidentally, the decision formula is not 
limited to this one, and the following formula (6) may 
also be used: 



Y\ |Ni - ni| < constant value . 



(6) 
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Although the above-described example has 
referred to an examination of a known cancer shadow, 
another method may be used in which reference data on 
normal shadows of blood vessel cross sections are 
5 prepared; and, when a shadow coincides with the 
reference data, the shadow is excluded from focus 
candidates. Furthermore, it is also possible to 
discriminate between shadows by not only the shape 
fitting between the number of loop turns and the curve 

10 of a graph of an average density value for each loop, 

but also the shape fitting with the curve of a graph of 
loop number and maximum value for each loop. 

The decision making subroutines Bl to B3 
executed in Steps S72, S74.and S76 of Fig. 11 will be 

15 described below. Figs. 20a and 20b constitute a 
flowchart showing details of each of the decision 
making subroutines Bl to B3 for identifying a shadow on 
the basis of the anisotropy of the shadow. Figs. 21a, 
21b and 22a, 22b are views conceptually showing the 

20 manner of processing of each of these decision making 
subroutines Bl to B3. Figs. 21a, 21b relate to the 
case of a focus shadow, and Figs. 22a, 22b relate to 
the case of a blood vessel cross-sectional shadow. 
Details of these decision making subroutines Bl to B3 

25 will be described below in the order of the steps 
thereof . 

[Step S30] The CPU 40 initializes an angle 9 
to, for example, 0=0 degrees. In each of Figs. 21a 
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and 22a, the angle 0 = 0 is a line which is shown by an 
arrow extending from a central position M of a shadow 
in the rightward horizontal direction. 

[Step S31] The CPU 40 determines a density 
5 distribution Vr of the shadow located on an a axis at 
the angle 9 and at a radius r from the center M of the 
shadow, and a density distribution V90r of the shadow 
located on an p axis at the angle 0+90 degrees and at 
the radius r. 

10 [Step S32] In the case of Fig. 21a, since 

the positions of the radius r on the a axis and the P 
axis lie inside the shadow, the density distributions 
Vr and V90r assume an equal value. On the other hand, 
in the case of Fig. 22a, the position of the radius r 

15 on the a axis lies outside the shadow and the position 
of the radius r on the P axis lies inside the shadow, 
so that the density distributions Vr and V90r assume 
remarkably different values. Accordingly, the CPU 40 
can make a comparison decision as to these values and 

20 determines whether the shadow is a focus candidate 
shadow. Specifically, in this step S32, the CPU 40 
will substitute the density distribution Vr located at 
the radius r on the a axis at the angle 9 and the 
density distribution V90r located at the radius r on 

25 the p axis at the angle 9+90 degrees into the 

following formula (7) to find the anisotropy (or else 
correlation) of the shadow: 
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r = max 

90-degree anisotropy (0) = £ |V90r - Vr| - 

r = rO 

... (7) 

In the above formula (7), after the absolute 
value has been found, summation processing is 
5 performed. A formula such as that which finds an 
absolute value after having performed summation 
processing can also be used as a formula which 
expresses anisotropy. Although Fig. 21a shows the case 
where the radius r is a positive value, the radius r 

10 may also be a, negative value. A correlation may also 
be found with respect to only a radius rl in each of 
Figs. 21b and 22b. In this case, since the lengths 
differ, a correlation of average values is found. 
Furthermore, the angle 9 of the 90-degree anisotropy (0) 

15 found by the above formula (7) may also be varied in 
the range of 0-360 degrees to find the anisotropy 
expressed by the following formula (8): 

359 

anisotropy = 90-degree anisotropy (0) . 
o 

... (8) 

20 Otherwise, the anisotropy expressed by the 

following formula (9) may also be found instead of the 
above formula (8): 



anisotropy = ] J 90-degree anisotropy (0). 
o 

... (9) 
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[Step S33] The CPU 40 determines whether the 
anisotropy (or correlation) found in Step S32 is larger 
than the maximum anisotropy (or the minimum 
correlation) found in the past. If the CPU 40 
5 determines that the anisotropy (or correlation) is 
larger than the maximum anisotropy (or the minimum 
correlation) (yes), the CPU 40 proceeds to Step S34; 
whereas, if the CPU 40 determines that the anisotropy 
(or correlation) is not larger than the maximum 

10 anisotropy (or the minimum correlation) (no) , the CPU 
40 jumps to Step S35. Incidentally, even in the case 
where this processing is in the initial cycle and the 
maximum anisotropy (or the minimum correlation) does 
not exist, the CPU 40 proceeds to Step S34 . 

15 [Step S34] The CPU 40 sets the anisotropy 

(or correlation) found in Step S33 as the maximum 
anisotropy (or the minimum correlation) , and updates 
the value of the maximum anisotropy (or the minimum 
correlation) . 

20 [Step S35] The CPU 40 adds a small angle 8 to 

the angle 0 to set the angle 0 to an angle (0 + 8) . 
Incidentally, the small angle 8 is, for example, one 
degree, but may also be another value. 

[Step S36] The CPU 40 determines whether 

25 computations on anisotropy (or correlation) over all 

angles 0 of 0-360 degrees have been completed. If the 
CPU 40 determines that the computations have been 
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completed (yes), the CPU 40 proceeds to Step S37; 
whereas, if the CPU 40 determines that the computations 
have not been completed (no) , the CPU 40 returns to 
Step S31 and repeats similar processing until the angle 
5 9 reaches 360 degrees. 

[Step S37] The CPU 40 determines whether the 
maximum anisotropy is larger than a predetermined value 
(the minimum correlation is smaller than a 
predetermined value) . If the CPU 40 determines that 

10 the maximum anisotropy is larger (the minimum 

correlation is smaller) , the CPU 40 proceeds to Step 
S38, whereas if the CPU 40 determines that the maximum 
anisotropy is not larger (the minimum correlation is 
not smaller) , the CPU 40 proceeds to the next 

15 subroutines CI to C3. Incidentally, a decision 

comparison constant in each of the steps is a value 
determined according to the conditions (such as slice 
thickness and tube current) of photography with an X- 
ray CT device, and may also be automatically selected. 

20 [Step S38] Since it has been determined in 

Step S37 that the maximum anisotropy is larger than the 
predetermined value (the minimum correlation is smaller 
than the predetermined value) , the CPU 40 excludes the 
shadow from focus candidate shadows, and proceeds to 

25 the next subroutines CI to C3. In the case where the 
above-described anisotropy is calculated on an actual 
focus shadow, such as a cancer shadow, the value of the 
anisotropy tends to be small (large in the case of the 
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correlation) . Accordingly, shadows other than a focus 
candidate shadow can be effectively excluded by these 
decision making subroutines CI to C3. Specifically, 
actual focus shadows in many cases exhibit shapes close 
5 to circles, as shown in Fig. 21a, and as shown in Fig. 
21b, the density difference between a density 
distribution Vrl of the shadow located at the radius rl 
at the angle 0 and a density distribution V90rl of the 
shadow located at the radius rl at the angle 0+90 

10 degrees is comparatively small, and the anisotropy of 

the shadow tends to be small. On the other hand, blood 
vessel cross-sectional shadows are elongated, as shown 
in Fig. 22a, and, as shown in Fig. 22b, the density 
difference between the density distribution Vrl of the 

15 shadow located at the radius rl at the angle 0 and the 
density distribution V90rl of the shadow located at the 
radius rl at the angle 6+90 degrees is comparatively 
large, and the anisotropy of the shadow tends to be 
large. Accordingly, the CPU 40 can easily discriminate 

20 between a focus shadow and a blood vessel shadow by a 
value indicative of the anisotropy found by the above 
formula (8) or (9) . 

Incidentally, although the above formula (7) 
uses the absolute value of the difference between the 

25 density distribution V90r and the density distribution 
Vr, this invention is not limited to this example, and 
the absolute value may be raised to the 5-th power (5 = 
2 to 4). In addition, the correlation is not limited 
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to density distribution, and may also be a correlation 
of computation results, such as a density gradient 
correlation. In addition, since the computation result 
of the above formula (8) or (9) is in general a large 
5 value, the computation result may also be multiplied by 
a predetermined constant, so that it can be rounded off 
to a small value that is easy to handle. Moreover, 
although a correlation angle of 90 degrees is an angle 
most effective in making a decision, this invention is 

10 not limited to 90 degrees, and an appropriate angle 
within the range of 90 degrees ± 30 degrees may be 
selected as a correlation angle, so that the anisotropy 
thereof may be found. Furthermore, the computation 
result of the above formula (8) or (9) (for example, 

15 90-degree anisotropy) may be used to calculate a 
standard deviation or the like, and the standard 
deviation or the like can also used for decision. This 
invention may use any formula that can find a 
correlation of shadow densities in two directions 

20 spaced substantially 90 degrees apart, and is not 

limited to the above formula (8) or (9), and may also 
use the above formula (7). 

The decision making subroutines CI to C3 
executed in Steps S72, S74 and S76 of Fig. 11 will be 

25 described below. Figs. 23a, 23b constitute a flowchart 
showing details of each of the decision making 
subroutines CI to C3 for identifying a shadow on the 
basis of the ratio of the long radius to the short 
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radius of the shadow. Figs. 24a, 24b conceptually show 
the manner of processing of each of these decision 
making subroutines CI to C3 . Although the above- 
described decision making subroutines Bl to B3 identify 
5 a shadow by using the anisotropy of each of shadow 
density distributions in two directions spaced 
substantially 90 degrees apart, these decision making 
subroutines CI to C3 identify a shadow by using the 
ratio of lengths of a shadow in two directions spaced 

10 substantially 90 degrees apart. Details of these 

decision making subroutines CI to C3 will be described 
below in the order of the steps thereof. 

[Step S50] The CPU 40 positions the center 
of rotation near the center of a shadow density. 

15 Namely, as shown in Fig. 24a, the CPU 40 sets the 

center of rotation of the a axis and the P axis with 
radii of predetermined lengths to the center M of the 
shadow. In the case of a focus shadow, since a 
plurality of peaks generally appear in its density 

20 distribution, the vicinity of the center of the shadow 
is set as the average position of this plurality of 
peaks.- Incidentally, as described previously, on the 
basis of a binary-image shadow obtained by binarizing 
the shadow, the center-weight position of the shadow 

25 may be set as the central coordinates, or the position 
found in Fig. 17b may also be set as the central 
coordinates . 

[Step S51] The CPU 40 initializes the angle 9 
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to, for example, 9=0 degrees, and initializes the 
maximum ratio of lengths of the shadow in two 
directions spaced substantially 90 degrees apart to, 
for example, "1". The angle 0 = 0 is shown by an arrow 
5 extending from the center M of the shadow in the 
rightward horizontal direction in Fig. 24a. 

[Step S52] The CPU 40 initializes a radius R 
to a small radius R0 near 0, and initializes both a 
first recording flag 1 and a second recording flag 2 to 
10 "0". 

Through the next steps S53 to S58, as shown 
in Fig. 24a, the CPU 40 finds the radius rl on the a 
axis extending from the center M, which is the 
reference of the shadow, and where angle 6 is given 

15 different values and a radius r2 on the P axis at the 
angle 0+90 degrees. The respective radii rl and r2 
represent the distances from the origin M to the 
boundary of the shadow, and this boundary is determined 
by finding the initial positions where the values of 

20 density curves al and pi reach about T% of the density 
value at the origin, as shown in Fig. 24b. 
Incidentally, the value of T% can. be arbitrarily set, 
and is herein set to T = 75%. It goes without saying 
that CT values or values of a multi-valued image 

25 themselves can also be used instead of percent. 

[Step S53] The CPU 40 determines whether the 
first recording flag 1 is "0" and the density value of 
a pixel at the radius R in the direction of the a axis 
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is a predetermined value or less. If the CPU 40 
determines that the density value is not larger than 
the predetermined value (Yes), the CPU 40 proceeds to 
Step S54; whereas, if the CPU 40 determines that the 
5 density value is larger than the predetermined value 

(No), the CPU 40 jumps to Step S55. Incidentally, this 
predetermined value is a value obtained by multiplying 
the density value of the shadow at the origin by the 
above-described value T. Namely, in this step, the CPU 

10 40 determines whether a pixel at the radius R lies on 
the boundary (edge) of the shadow. # 

[Step S54] Since it has been determined in 
Step S53 that the density value of the pixel at the 
radius R in the direction of the a axis is not larger 

15 than the predetermined value, this radius R indicates 
the distance from the origin M to the boundary of the 
shadow. Accordingly, the CPU 40 selects this radius R 
as the radius rl and sets "1" to the first recording 
flag 1, to define the radius rl . 

20 [Step S55] The CPU 40 determines whether the 

second recording flag 2 is "0" and whether the density 
value of a pixel at the radius R in the direction of 
the p axis is a predetermined value or less. If the 
CPU 40 determines that the density value is not larger 

25 than the predetermined value (Yes) , the CPU 40 proceeds 
to Step S56; whereas, if the CPU 40 determines that the 
density value is larger than the predetermined value 
(No), the CPU 40 jumps to Step S57 . 
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[Step S56] Since it has been determined in 
the above step S55 that the density value of the pixel 
at the radius R in the direction of the p axis is not 
larger than the predetermined value, this radius R 
5 indicates the distance from the origin M to the 
boundary of the shadow. Accordingly, the CPU 4 0 
selects this radius R as the radius r2 and sets "1" to 
the second recording flag 2, to define the radius r2 . 

[Step S57] The CPU 40 adds a small distance e 

10 to the radius R to set the radius R to a radius (R + 8) . 
Namely, the CPU 40 performs the processing of 
increasing the radius R by the small increment 8. 

[Step S58] The CPU 40 determines whether the 
radius R is a predetermined maximum value (for example, 

15 the maximum radius of a shadow which is a decision 

target), and, if the CPU 40 determines that the radius 
R is not the maximum value (No) , the CPU 40 returns to 
Step S53; whereas, if the CPU 40 determines that the 
radius R is the maximum value (Yes) , the CPU 40 returns 

20 to Step S59. The CPU 40 can find the radius rl on the 

a axis at the angle 0 and the radius r2 on the p axis at 
the angle 8+90 degrees by repeating the processing of 
Steps S54 to S58. Incidentally, in the description of 
this step, reference has been made to the case where 

25 the CPU 40 leaves the loop of Steps S53 to S58 

depending on the size of the radius R; however, instead 
of this step S58, the CPU 40 can be made to leave the 
loop according to whether both the first recording flag 
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1 and the second recording flag 2 are "1", 

[Step S59] The CPU 40 finds the ratio of the 
radius rl to the radius r2 : rl/r2. In this step, the 
ratio = rl/r2 is found, but since the ratio is made to 
5 be not smaller than 1, the larger of the radius rl and 
the radius r2 is made the numerator and the smaller is 
made the denominator. 

[Step S60] The CPU 4 0 determines whether the 
ratio found in Step S59 is larger than a maximum ratio, 
10 and if the CPU 40 determines that the ratio is larger 
(Yes), the CPU 40 proceeds to Step S61; while, if the 
CPU 40 determines that the ratio is not larger (No) , 
the CPU 40 jumps to Step S62. 

[Step S61] Since the ratio found in Step S59 
15 is larger than the maximum ratio, the CPU 40 sets that 
ratio to be the new maximum ratio. Incidentally, since 
the value "1" defined as the maximum ratio in Step S51 
is set in advance, the initially found ratio is 
recorded as the maximum ratio. 
20 [Step S62] The CPU 40 adds the small angle 5 

to the angle 9 to set the angle 0 to the angle (0 + 5) . 
Incidentally, the small angle 8 is, for example, one 
degree, but may also be another value. 

[Step S63] The CPU 40 determines whether the 
25 angle 0 in Step S62 has reached 360 degrees, and if the 
CPU 40 determines that the angle 0 is smaller than 360 
degrees (No), the CPU 40 jumps to Step S52; whereas, if 
the CPU 40 determines that the angle 0 = 360 degrees 
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(Yes), the CPU 40 proceeds to Step S64. In this 
manner, it is possible to find the maximum ratio of the 
radius rl to the radius r2 where the angle 0 is varied 
from 0 to 360 degrees. 
5 [Step S64] The CPU 40 determines whether the 

maximum ratio is larger than a predetermined constant, 
and if the CPU 40 determines that the maximum ratio is 
larger (Yes), the CPU 40 proceeds to Step S65; whereas, 
if the CPU 40 determines that the maximum ratio is not 

10 larger (No) , the CPU 40 proceeds to the next decision 
making subroutines Dl to D3 . 

[Step S65] Since it has been determined in 
Step S64 that the maximum ratio is larger than the 
predetermined constant, the CPU 40 excludes the shadow 

15 from focus candidate shadows and proceeds to the next 
decision making subroutines Dl to D3 . In this manner, 
the CPU 40 varies the angle 0 in the range of 0 to 360 
degrees, and if the maximum ratio of the radius rl and 
the radius r2 obtained at this time is larger than the 

20 predetermined constant, the CPU 40 excludes the shadow 
from focus candidate shadows. This is because focus 
candidates are small in anisotropy and approximately 
close to circular shapes and the ratios of their radii 
rl to their radii r2 are in many cases smaller than the 

25 predetermined constant. Incidentally, although each of 
Figs. 21b, 22b and 24b shows only anisotropy in the 
positive direction on the a axis, the case of 
anisotropy in the negative direction is also included 



in this invention. 

In the above-described embodiment, reference 
has been made to the case where anisotropy 
(correlation) is found by using shadow density 
5 distributions in two directions spaced substantially 90 
degrees apart or the ratio of the lengths of shadows in 
two directions spaced substantially 90 degrees apart, 
but anisotropy may also be found by using other 
methods. For example, anisotropy (correlation) may 

10 also be found by causing the a axis and the P axis 

shown in Fig. 22a to move like the long hand and the 
short hand of a clock. In this case, assuming that the 
a axis and the p axis are the short hand and the long 
hand, respectively, while the a axis is making one 

15 rotation, the P axis makes several hundred rotations. 
In Fig. 22a, the a axis and the p axis are shown to be 
perpendicular to each other, but this angle may be made 
an arbitrary angle r| . First, a density distribution in 
the direction of the a axis is found by determining the 

20 angle 0, then the angle is changed by r] to find a 

density distribution in the direction of the p axis, 
and subsequently the anisotropy (correlation) of both 
density distributions is found. In the case where both 
the a axis and the P axis are superposed on a blood 

25 vessel shadow, the anisotropy is small and pixel values 
along the a axis and p axis are large, and the 
distribution of the pixel values is flat. On the other 
hand, if the shadow is circular, such features are not 
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observed, and pixel values along the a axis and P axis 
are large and their distribution is flat. Accordingly, 
if a case of small anisotropy is discovered, it can be 
inferred that the angle r) at this time is the branching 
5 angle of a blood vessel. For example, in Fig. 22a, 
when the angle r\ is about 180 degrees and about 4 5 
degrees, the anisotropy becomes small, so that the 
shadow is inferred to be a blood vessel and can be 
excluded from focus candidate shadows. 

10 The decision making subroutines Dl to D3 

executed in Step S72, S74 and S76 of Fig. 11 will be 
described below. Fig. 25 is a flowchart showing 
details of each of the decision making subroutines Dl 
to D3 . Figs. 26a to 26d conceptually show the manner 

15 of processing of each of these decision making 

subroutines Dl to D3, of which Fig. 26a is a view 
showing one example of a CT image. Fig. 2 6b is a view 
showing one example of a binary image obtained by 
binarizing this CT image. Figs. 26c and 26d are views 

20 showing on an enlarged scale a part of this binary 

image, and which show how a decision is made by each of 
the decision making subroutines Dl to D3 . By applying 
the binary image processing shown in Figs. 5 and 6 to 
the CT image shown in Fig. 26a, shadows 261 and 262, 

25 which seem to be focus candidates, are extracted in the 
binary image shown in Fig. 26b. Since these shadows 
261 and 262 are the same in size and shape, it is 
difficult to discriminate between the shadows 261 and 
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262 by means of the above-described decision. However, 
since the shadow 262 appears on a wall portion of the 
shadow, the possibility that the shadow 262 is a cancer 
shadow is high. The shadow 261 appears in the inside 
5 of the shadow, and the possibility that the shadow 261 
is a focus candidate is low. For this reason, in the 
decision making subroutines Dl to D3, a decision is 
made as to whether a shadow is located on a wall 
portion, and, on the basis of the result of this 

10 decision, a decision is made as to whether the shadow 
is a focus candidate shadow. In the case where a 
shadow exists near a wall, as a rotating radius passes 
through the wall, the pixel values of the shadow that 
cross the radius sharply vary, and the resultant high 

15 variation appears at two locations of radii. 

Accordingly, in the case where the shadow is in contact 
with the wall, an angle of elevation 9 of the radii at 
these two locations is larger than a reference value, 
so that the shadow is identified as a focus candidate 

20 shadow. On the other hand, in the case where the 

shadow is inside the wall, the angle of elevation 0 of 
the radius is smaller than the reference value, so that 
the shadow is not identified as a focus candidate 
shadow. Details of these decision making subroutines 

25 Dl to D3 will be described below step by step. 

[Step S91] The CPU 40 sets the radius r used 
to search a shadow to an initial value. The radius R 
in this processing is made to be a value corresponding 
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to the size of each shadow. For example, about 1.5 
times the maximum diameter of a shadow, which is a 
target is set to be the initial value of the radius r. 
[Step S92] The CPU 40 rotates a moving 
5 radius r by about 5 degrees at one time in the range 

from 0=0 degrees to 0 = 360 degrees, and finds density 
distributions V0 to V355 of the shadow located at the 
distance r from the center of the shadow and at the 
respective angles, and applies predetermined 

10 computations on these density distributions V0 to V355. 
Then, if the moving radius of radius r crosses the 
boundary of the shadow at two or more radii 81 and 92, 
the CPU 40 finds a maximum angle 0 between radii 91 and 
92. The radii 91 and 92 are determined in the following 

15 manner. The CPU 40 subtracts the density distribution 
V(9 + 5) at an angle (9 + 5) which is 5 degrees larger 
than a certain angle 9, from a density distribution V9 
at the angle 9; and, if the difference is a positive 
value and the absolute value is larger than a 

20 predetermined value, the CPU 40 sets the larger angle (9 
+ 5) to be 91. In Figs. 26c and 26d, a moving radius 
r9l corresponds to the moving radius at the angle 91. 
On the other hand, in the case where the CPU 40 
subtracts the density distribution V(9 + 5) from the 

25 density distribution V9, if the difference is a negative 
value and the absolute value is larger than the 
predetermined value, the CPU 40 sets the smaller angle 9 
to be 92. In Figs. 26c and 26d, a moving radius r92 



corresponds to the moving radius at the angle 02 . After 
the angle 01 and the angle 02 have been found in this 
manner, the CPU 40 defines, as the maximum angle 0, the 
angle formed by the moving radius r01 at the angle 02 in 
5 the clockwise direction relative to the moving radius 
r02 at the angle 02. incidentally, this method of 
finding the maximum angle © is merely one example, and 
it goes without saying that the maximum angle 0 can be 
found by other methods. In addition, although the 

10 description has been made in connection with the case 
where the moving radius is rotated 5 degrees at one 
time, this case is not limiting, and it goes without 
saying that the angle of rotation may be changed in 
increments ranging from 1 degree to 10 degrees. 

15 [Step S93] The CPU 40 determines whether the 

maximum angle 0 found in Step S93 is larger than a 
predetermined constant value, and, if the CPU 40 
determines that the maximum angle 0 is larger (yes) , 
the CPU 40 proceeds to the next decision making 

20 subroutines El to E3; whereas, if the CPU 40 determines 
that the maximum angle © is not larger (no) , the CPU 40 
proceeds to Step S94. The constant value is herein 
made 90 degrees. This is because the maximum angle © 
is near 180 degrees in the case of a focus shadow which 

25 appears on a wall portion. Accordingly, in such a 

case, the shadow is left as a focus candidate shadow 
and is subjected to the processing of the next decision 
making subroutine . 
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[Step S94] Since it has been determined by 
the decision in Step S93 that the maximum angle 0 is 
smaller than the predetermined constant value, the CPU 
40 excludes the shadow from focus candidate shadows and 
5 proceeds to the next decision making subroutines El to 
E3 . In many cases, a focus shadow, such as a cancer 
shadow, appears on a wall portion, but a normal shadow 
does not appear on a wall portion. Therefore, through 
this processing, a shadow which does not exist on a 

10 wall portion is efficiently excluded from focus 
candidate shadows . 

The decision making subroutine El executed in 
Step S72 of Fig. 11 will be described here. Fig. 27 is 
a flowchart showing details of the decision making 

15 subroutine El. Figs. 28a, 28b conceptually show the 

manner of processing of this decision making subroutine 
El. Fig. 28a shows processing for a blood vessel 
cross-sectional shadow generated by applying the binary 
image processing of Figs. 5 and 6, and Fig. 28b shows 

20 processing for a focus shadow. When the binary image 

processing of Figs. 5 and 6 is applied to a CT image to 
exclude the shadow of a blood vessel portion thinner 
than a predetermined value, the shadow of the remaining 
portion becomes a shadow which seems to be a focus 

25 shadow, as shown in Fig. 28a. Therefore, the blood 

vessel cross-sectional shadow shown in Fig. 28a must be 
excluded from focus candidates. For this reason, in 
this decision making subroutine El, this blood vessel 



cross-sectional shadow is extracted and excluded. 
Namely, to exclude such a blood vessel cross-sectional 
shadow from focus candidates, the CPU 40 finds a long 
diameter and a short diameter of the shadow from the 
5 minimum value and the maximum value of the portion of 
the rotating straight line which intersects the shadow, 
and samples pixel values which are respectively located 
a predetermined distance outward from the shadow along 
extensions of the long diameter and the short diameter. 

10 In the case of the blood vessel cross-sectional shadow, 
the pixel value on the extension of the long diameter 
and the pixel value on the extension of the short 
diameter indicate clearly different values. In the 
case of the focus shadow, both pixel values indicate 

15 approximately the same value. Accordingly, on the 

basis of this fact, it is possible to determine whether 
the shadow is a focus candidate shadow. Details of 
this decision making subroutine El will be described 
below, step by step. 

20 [Step S101] The CPU 40 finds the angle 0 

relative to the minimum moving radius while rotating 
the moving radius. The CPU 40 positions the middle 
point of the straight line of predetermined length to 
be close to the center of the shadow density, and sets 

25 the middle point of the straight line to be the center 
of rotation and rotates the straight line about the 
center of rotation by about 1 degree at one time in the 
range from 0=0 degrees to 0 = 360 degrees. During 



this time, the CPU 40 sequentially calculates the 
length of the portion of the radius which crosses the 
shadow at each of the angles, and finds an angle <D of 
the minimum value of the moving radius. Incidentally, 
this processing is performed on shadows of multi-valued 
images. The incremental angle of rotation is not 
limited to 1 degree, and may be other angles. 

[Step S102] This processing is performed on 
a CT image which is not yet subjected to multi-valued 
image processing. The CPU 40 finds density values (CT 
values) vl and v2 at two points located a predetermined 
distance "outR" outward from the shadow along the 
extension of the moving radius at the angle <D, and 
finds density values (CT values) v3 and v4 at two 
points located a predetermined distance outR outward 
from the shadow along the extension of a moving radius 
perpendicular to the moving radius at the angle 3>. 

[Step S103] The CPU 40 substitutes the 
density values found in the previous step S102 Into the 
following formula (10) or (11) : 

v3 + v4 > ( (vl + v2) + constant), ... (10) 

v3 + v4 > ( (vl + v2) x constant). ... (11) 

If the CPU 40 determines that the formula 
(10) or (11) is satisfied (yes), the CPU 40 proceeds to 
Step S104, whereas if the CPU 40 determines that the 



formula (10) or (11) is not satisfied (no), the CPU 40 
brings the processing to an end and proceeds to the 
next decision making subroutine Fl . In the case of the 
blood vessel cross-sectional shadow shown in Fig. 
5 28(a), the density values (CT values) vl and v2 at the 
two points located the predetermined distance outR 
outward from the shadow along the extension of the 
moving radius at the angle 0> become extremely small 
values. On the other hand, the density values v3 and 

10 v4 at the two points located the predetermined distance 
outR outward from the shadow along the extension of the 
moving radius perpendicular to the moving radius at the 
angle <t> become comparatively large values, because the 
density values v3 and v4 are located on the blood 

15 vessel cross-sectional shadow. Accordingly, in the 

case of the blood vessel cross-sectional shadow shown 
in Fig. 28a, the above-described formula (10) or (11) 
is satisfied. On the other hand, in the case of the 
focus shadow shown in Fig. 28b, since the density 

20 values vl to v4 become approximately the same value, 
the above-described formula (10) or (11) is not 
satisfied. 

[Step S104] Since it has been determined by 
the decision in Step S103 that the above-described 
25 formula (10) or (11) is satisfied, the CPU 40 excludes 
the shadow from focus candidate shadows, and proceeds 
to the next subroutine Fl . Through this processing, 
the blood vessel cross-sectional shadow, which is 
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generated by the multi-valued image processing of Figs . 
5 and 6 and seems to be a focus shadow, is effectively 
excluded from focus candidate shadows. Incidentally, 
in the above-described step S102, the density values v3 
5 and v4 are found at the two points located a 

predetermined distance outR outward from the shadow 
along the extension of the moving radius perpendicular 
to the moving radius at the angle <D . However, as a 
result of Step S101, an angle O relative to the maximum 

10 value of the moving radius may also be used, so that 

the density values v3 and v4 may be found at two points 
located at the predetermined distance outR outward from 
the shadow along the extension of a moving radius at 
that angle O. In addition, although in the above- 

15 described embodiment the density values vl and v2 are 

determined from the moving radius of minimum value, the 
density values vl and v2 may instead be determined from 
the moving radius of maximum value so that the density 
values v3 and v4 may be determined from the moving 

2 0 radius perpendicular to the moving radius of maximum 
value . 

The decision making subroutine Fl executed in 
Step S72 of Fig. 11 will be described below. Fig. 29 
is a flowchart showing details of the decision making 
25 subroutine Fl . Figs. 30a and 30b conceptually show the 
manner of processing of this decision making subroutine 
Fl . Fig. 30a shows processing for a blood vessel 
cross-sectional shadow generated by applying the multi- 
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valued image processing of Figs. 5 and 6, and Fig. 30b 
shows the density distribution generated in the course 
of the processing for this blood vessel cross-sectional 
shadow. Similarly to the above-described decision 
5 making subroutine El, the decision making subroutine Fl 
performs the processing of extracting and excluding a 
blood vessel cross-sectional shadow. Details of this 
decision making subroutine El will be described below 
in the order of the steps thereof. 

10 [Step Sill] The CPU 40 sets a radius r at 

which to search a shadow at an initial value. For 
example, the radius r is set to about 7 mm in the case 
of the first decision processing of Fig. 10 which is 
performed when the size of the shadow is smaller than 

15 the predetermined value Ra, or the radius r is set to 
about 20 mm in the case of the second decision 
processing of Fig. 10, which is performed when the size 
of the shadow is not smaller than the predetermined 
value Ra and is smaller than the predetermined value 

20 Rb, or the radius r is set to about 30 mm in the case 
of the third decision processing of Fig. 10, which is 
performed when the size of the shadow is larger than 
the predetermined value Rb . These values are parameter 
values which can be variously modified. 

25 [Step S112] The CPU 40 rotates at the radius 

r by increments of one degree about a point in the 
vicinity of the center of the shadow, and samples each 
pixel value in the range of angles 9 = 0 to 360 degrees 
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and generates a density waveform, as shown in Fig. 30b. 
Fig. 30b shows the result obtained. by sampling density 
values at the position of the radius r from the shadow 
center of the blood vessel cross-sectional shadow shown 
5 in Fig. 30a. 

[Step S113] The CPU 40 extracts an angle at 
which a density peak appears, on the basis of the 
density waveform generated in Step S113. For example, 
the CPU 40 differentiates the density waveform, and 

10 extracts an angle relative to the case where the 
differential value is "0", as an angle at which a 
density peak appears. In the case of a blood vessel 
cross-sectional shadow, since the density near the axis 
of a blood vessel shows a maximum value, an angle at 

15 which a density peak appears and the longitudinal 
direction of the blood vessel are approximately 
coincident with each other. In the case of Figs. 30a 
and 30b, the angles © at which density peaks appear are 
a = 10 degrees, P = 170 degrees and y = 210 degrees. 

20 [Step S114] The CPU 40 sums CT values on the 

radius r at various angles. In Fig. 30a =, since 
density peaks respectively appear at the three angles 
a, P and y, the CPU 40 finds the sums of CT values on 
the radius r at the respective angles a, P and y. The 

25 sum of CT values on the radius at the angle a is 

sum (a), the sum of CT values on the radius at the angle 
P is sum(p), and the sum of CT values on the radius at 
the angle y is sum(y). 
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[Step S115] The CPU 40 finds the bisector of 
an angle made by adjacent radii, and finds the sum of 
CT values on the bisector. In the case of Fig. 30a, 
since the angles at which the respective density peaks 
5 appear are the three angles a, P and y, the bisectors of 
the radii which are adjacent to each other at the 
respective angles are a bisector a(5 formed between the 
angle a and the angle p, a bisector py formed between 
the angle p and the angle y, and a bisector yet formed 

10 between the angle y and the angle a. The CPU 40 finds 

the sum of CT values on the bisector ctp, the bisector py 
and the bisector yet. The sum of the CT values on the 
bisector ap is sum(otP), the sum of the of the CT values 
on the bisector ap is sum(otP), the sum of the CT values 

15 on the bisector py is sum(py), and the sum of the CT 
values on the bisector yet is sum (yet). 

[Step S116] The CPU 40 determines whether 
each of the sums found in the above-described Steps 
S114 and S115 satisfies the following predetermined 

20 conditions. If the CPU 40 determines that the 

following predetermined conditions are satisfied (yes) , 
the CPU 40 proceeds to the next step S117; whereas, if 
the CPU 40 determines that the following predetermined 
conditions are not satisfied (no) , the CPU 40 brings 

25 the processing to an end, and proceeds to Step S73 of 
Fig. 11. In this step, any one of the following 
predetermined conditions are used. 

(Predetermined Condition 1) 
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sum(ap) x constant < sum (a), 
sum(a(5) x constant < sum(p), 
sum(Py) x constant < sum(P), 
sum(Py) x constant < sum(y), 
5 sum(ya) x constant < 30111(7), and 

sum(ya) x constant < sum (a). 

In the case where all of the above-described 
condition formulas are satisfied, the predetermined 
condition 1 is determined as satisfied. 
10 (Predetermined Condition 2) 

sum(aP) + constant < sum (a), 

sum(ap) + constant < sum(P), 

sum(Py) + constant < sum(P), 

sum(py) + constant < sum(y) , 
15 sum(ya) + constant < sum(y) , and 

sum (ya) + constant < sum (a). 

In the case where all of the above-described 
condition formulas are satisfied, the predetermined 
condition 2 is determined as satisfied. 
20 (Predetermined Condition 3) 

average (a~p) + constant < sum (a), 
average (a~p) + constant < sum(P), 
average(p-y) + constant < sum(p), 
average (P~y) + constant < sum(y), 
25 average (y~a) + constant < sum(y), and 

average (y~a) + constant < sum (a). 
In the case where all of the above-described 
condition formulas are satisfied, the predetermined 



condition 3 is determined as satisfied. In the above 
condition formulas, the term "average (a-[3) " indicates 
the average value of the CT values contained in a 
sector from the angle a to the angle p, and the term 
5 "average (a) " indicates the average value of the CT 

values on the radius r at the angle a. Accordingly, in 
this case, it is necessary to newly add processing for 
finding the average values. Incidentally, it goes 
without saying that, in Step S116, the CPU 40 may 
10 determine whether all of these conditions 1 to 3 are 
satisfied . 

[Step S117] The CPU 40 excludes from focus 
candidate shadows the shadow which has been determined 
as satisfying the predetermined condition, as a result 

15 of the decision of Step S116, brings this processing to 
an end, and proceeds to Step S73 of Fig. 11. 

In the above-described manner, the shadows 
other than the focus candidate shadow 22 shown (bl) to 
(b3) in Fig. 3 are sequentially deleted, and only the 

20 focus candidate shadow 22 is finally left as shown at 
(b3) in Fig. 3. This focus candidate shadow 22 is the 
final selected image (Fig. 3 at (b3) ) , and is combined 
with the original CT image 20 (Fig. 3 at (al)), so that 
the final combined image shown in Fig. 3 at (a2) is 

25 displayed on the CRT display 48. On the image shown in 
Fig. 3 at (a2), the focus candidate shadow 22 is 
enclosed with the circular marker M so that the 
operator's attention is drawn to the focus candidate 



shadow 22. Incidentally , only the focus candidate 
shadow 22 need be displayed in color or in a painted- 
out state. Images which are subjected to the 
extraction processing of sequentially excluding non- 
5 candidate shadows to select the focus candidate shadow 
22 are actually displayed in greater numbers than those 
shown in Fig. 3 at (b2) and 3 at (b3) . Fig. 3 merely 
shows part of the images displayed actually. 

Fig. 31 is a view of a modification of the 

10 display picture of Fig.- 3, and shows the case where a 

CT image and images being processed on a bit memory are 
displayed in combined form. Specifically, Fig. 3 
sequentially displays images which are being subjected 
to the extraction processing of sequentially excluding 

15 non-candidate shadows to select the focus candidate 

shadow 22; however, in Fig. 31, the original CT image 
20 is combined with each of images which are being 
processed as shown in Fig. 3 at (bl) to 3 at (b3) , and 
a resultant combined image 26 is sequentially 

20 displayed. Since the combined image is displayed in 

this manner, the operator (doctor) can serially observe 
the process of sequentially excluding non-candidate 
shadows from the CT image 20 and selecting the focus 
candidate shadow. Incidentally, the method of 

25 extracting and selecting a focus candidate shadow is 
not limited to. this embodiment; and, as shown in Fig. 
32 by way of example, there is also a method of finding 
average coordinates a ? and b' of respective shadows a 
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and b and excluding from focus candidate shadows the 
shadow a or b if the average coordinates a 1 or b 9 lie 
outside that shadow (the shadow b in the example of 
Fig. 32) . Also, a Quoit filter, Mahalanobis distance, 
5 Euclidean distance and the like may be used to select a 
focus candidate shadow. In the case where a focus 
candidate shadow is presented to the operator (doctor) , 
each image may also be stored in the magnetic disk unit 
44 together with information indicative of an 

10 undetected image, an image that is impossible to 

identify, or candidate image so that undetected images, 
images that are impossible to identify and candidate 
images may be displayed in separate windows, classified 
as shown in Fig. 33, in accordance with an instruction 

15 from the operator (doctor) . The above-described 

windows respectively display such images, but in the 
respective windows, image supplementary information for 
identifying the images, such as the patient names and 
the patient IDs of the respective images, may also be 

20 displayed in list form. In addition, information for 

identifying the nature of focus candidate shadows, such 
as a positive indication that shadow is a focus, a 
nature close to a positive (apparent-positive) and a 
negative indicating that a focus candidate shadow is 

25 not a focus, may also be displayed as image 

supplementary information. A display example of such 
image supplementary information is shown in Fig. 83. 

Although images are displayed in each of the 
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above-described windows, image supplementary 
information for identifying the images, such as the 
patient names and the patient IDs of the respective 
images, may also be displayed in list form. 
5 One example of a picture which is displayed 

on the CRT display 48 in the case where the processing 
of each of the above-described shadow decisions is 
executed will be described below. Fig. 34 is a view 
showing a display for setting the parameters required 

10 for the processing of each of the above-described 

decision making subroutines. Incidentally, there are 
optimum parameters depending on the sizes of shadows 
and the states of densities of shadows; and, when a 
"SMALL FOCUS" button, a "LARGE FOCUS" button, a 

15 "FROSTED-GLASS FOCUS" button or a "HIGH-DENSITY FOCUS" 
button is selected by a mouse cursor, the corresponding 
optimum parameters are set. When the setting of the 
parameters with the display of Fig. 34 is completed, a 
focus candidate extracting and displaying device which 

20 is not shown performs sequential or parallel processing 
in accordance with the main flowchart of Figs. 2a, 2b 
by using the parameters set for each of the kinds of 
shadows, and detects a small focus, a large focus, a 
ground-glass focus and a high-density focus, and 

25 combines each detected shadow with a cross-sectional 
image of a CT image as shown in Fig. 3 to display the 
combined image on the CRT display 48. 

A display method of indicating a detected 
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shadow portion to which attention is to be directed by 
enclosing an area of interest, such as a focus 
candidate shadow, with a marker (circle) will be 
described below. As shown in Fig. 35, in the case 
5 where focus candidate shadows (not shown) on a medical 
image 30, such as a CT image, an MR I image and an 
ultrasonic image, are enclosed with circles 31, 32 and 
33, if a plurality of focus candidate shadows are close 
to one another, the circles overlap and the focus 

10 candidate shadows themselves or the peripheries of the 
focus candidate shadows may become difficult to 
observe. In this embodiment, instead of overlapping 
and displaying the plurality of circles 31, 32 and 33, 
markers are displayed as an aggregation of circular 

15 arcs 34, 35 and 36, as shown in Fig. 36b. 

Specifically, in the case where the circles 31, 32 and 
33 which are respectively centered at focus candidate 
shadows pi, p2 and p3, overlap one another, the 
circular arcs contained in the overlap are erased and 

20 the circles 31, 32 and 33 are drawn as an aggregation 

of a plurality of circular arcs 34, 35 and 36, as shown 
in Fig. 36b. Incidentally, since focus candidate 
shadows are generally small, it is preferable that the 
diameters of the circles be made about 10 times the 

25 diameters of the focus candidate shadows. 

Fig. 37 is a flowchart indicating the 
processing for erasing the overlap among the above- 
described plurality of circles and for generating an 
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aggregation of the plurality of circular arcs. Namely, 
this flowchart shows details of the processing for the 
case of drawing the point q3 on the circle 33 of Fig. 
36a as the point q3 on the circular arc 36 of Fig. 36b. 
5 [Step S90] The CPU 40 determines whether the 

point q3 on the circle 33 that is centered at the focus 
candidate shadow p3 is contained in the circles 31 and 
32 centered at the other focus candidate shadows (the 
focus candidate shadows pi and p2 in Fig. 36a) . If the 

10 CPU 40 determines that the point q3 is contained (yes) , 
the CPU 40 proceeds to Step S91; whereas, if the CPU 40 
determines that the point q3 is not contained (no) , the 
CPU 40 proceeds to Step S92. 

[Step S91] Since the CPU 40 has determined 

15 in the previous step S90 that the point q3 overlaps the 
other circles, the CPU 40 brings the processing to an 
end without drawing the point q3 . 

[Step S92] Since the CPU 40 has determined 
in Step S90 that the point q3 does not overlap the 

20 other circles, the CPU 40 draws the point q3 and brings 
the processing to an end. In the case where the CPU 40 
draws the circle 33 that is centered at the focus 
candidate shadow p3, the CPU 40 performs the processing 
of the above-described steps S90 to S92 on all points 

25 on the circle. If the CPU 40 is to draw the circles 31 
and 32 that are centered at the focus candidate shadows 
pi and p2, the CPU 40 performs similar processing. 

In addition, in the extraction process of a 
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focus candidate shadow, by taking the inverse 
proportion of the results of the decision formulas (1) 
and (2) of Step S5 of Fig. 12, it is possible to find 
the probability that the focus candidate shadow is a 
5 focus (focus certainty) . Therefore, when the above- 
described circuit is to be displayed, it is possible to 
reflect the focus certainty by making the size of the 
circles proportional to the focus certainty or the size 
of the shadow. Incidentally, the circle may also be 

10 displayed as a thick circle or a large circuit, or in 
different colors (in the order of the highness of the 
focus certainty like red, yellow and blue) , or in 
flashing manner, in proportion to the focus certainty 
irrespective of the size of the circle. Furthermore, 

15 the markers are not limited to circles, and may also be 
rectangles or ellipses. In addition, in the case where 
a focus itself is extracted, a focus candidate shadow 
itself may be displayed in different colors or in 
flashing form to attract the operator's attention, or a 
. 20 buzzer or a sound may also be used to attract the 
operator 9 s attention . 

A display method for displaying to the 
operator (doctor) a CT image from which a focus 
candidate shadow is extracted, together with the above- 

25 described marker, will now be explained. Fig. 38 is a 
view showing one example of a case where a detection 
result image, in which a focus candidate shadow is 
enclosed with a marker, and a magnified image, in which 
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the portion within the marker is displayed on a 
magnified scale, are displayed in one display at the 
same time. As is apparent from the figure, the 
detection result image is the picture (a2) of Fig. 3 or 
5 Fig. 31, and this magnified image displays the portion 
within the marker in the detection result image in the 
state of being magnified at a predetermined 
magnification. By this magnified display, the operator 
(doctor) can more accurately observe the focus 

10 candidate shadow. The display shown in Fig. 38 is a 
standard picture which is designed to enable various 
display modes to be selected by display mode selecting 
buttons that are arranged in a column at the left-hand 
end of the picture. These display mode selecting 

15 buttons are respectively provided as icons assigned to 
six kinds of mode, i.e., standard display mode, 
horizontal order display mode, vertical order display 
mode,, distance order display mode, spiral order display 
mode and registration order display mode. Although not 

20 shown, there also exists a button for 

displaying/erasing the marker, but the illustration 
thereof is omitted. 

The standard mode is the mode of displaying 
images in the order in which extraction processing for 

25 focus candidate shadows is performed on the images, as 
shown in Fig. 39; and, if extraction processing is 
performed in the order of, for example, images a-d, the 
images a-d are displayed in that order. Switching of 
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pictures is performed by means of the picture switching 
buttons shown in Fig. 38 at the bottom right thereof. 
A picture switching button on which a downward triangle 
is displayed is a next-picture display button, and a 
5 picture switching button on which an upward triangle is 
displayed is a previous-picture display button. 
Incidentally, focus candidate shadows exist in the 
image c at two locations, and, in this case, a marker 
display switching button is displayed. In addition, a 
10 magnification change button for arbitrarily changing 
the display magnification of a magnified picture is 
also displayed, but the illustration thereof is omitted 
herein . 

The horizontal order display mode is the mode 
15 of dividing a CT image into 16 parts in the horizontal 
and vertical directions, as shown in Fig. 40a, 
assigning numbers to the 16 parts in order from top 
left to bottom left, and displaying focus candidate 
shadows in the ascending order of the numbers. 
20 Accordingly, in the case of a focus-candidate-shadow- 
extracted image, as shown in Fig. 39, a focus candidate 
shadow is displayed in order from top left to bottom 
left as shown in Fig. 41. At this time, the image c of 
Fig. 39 is displayed separately in the top and bottom 
25 sections of Fig. 41. 

The distance order display mode is the mode 
of dividing a CT image into 16 parts in the horizontal 
and vertical directions, as shown in Fig. 40b, 
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assigning numbers to the 16 parts in order from top 
left to top right, and displaying focus candidate 
shadows in the ascending order of the numbers. 
Accordingly, in the case of a focus-candidate-shadow- 
5 extracted image as shown in Fig. 39, a focus candidate 
shadow is displayed in order from top left to top 
right, as shown in Fig. 42. Incidentally, images 
having focus candidate shadows at approximately the 
same division position like the images a and d are 

10 displayed in the order of extraction processing. 

The distance order display mode is the mode 
of sequentially accessing an image having a focus 
candidate shadow at the smallest distance to the first 
displayed focus candidate shadow. The spiral order 

15 display mode is the mode of dividing a CT image into 40 
parts in the horizontal and vertical directions, as 
shown in Fig. 43, sequentially assigning numbers to the 
40 parts counterclockwise spirally in order from top 
left to bottom left, and displaying focus candidate 

20 shadows in the ascending order of the numbers. The 
registration order display mode is the mode of 
displaying images in the order of display registered in 
advance by an operator. Incidentally, it goes without 
saying that the above-described horizontal and vertical 

25 division number is merely one example and other 

division numbers may also be adopted. In the case of 
the spiral order display mode, although images are 
displayed in order from the outside, images may also be 
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displayed in order from the vicinity of the center 
toward the outside. The direction of the spiral may be 
either clockwise or counterclockwise. Furthermore, 
since the inside of a mark, such as a circle, has a 
5 different CT value, the inside of the mark may be set 
to an area of interest to adjust a display level and a 
display window and recalculate and modify a display 
conversion table, thereby easily identifiably 
displaying the mark. 

10 Incidentally, in the decision making 

subroutines Dl to D3 of Fig. 25, the CPU 40 makes a 
decision as to whether a shadow is located on a wall 
portion, and identifies the shadow on the basis of the 
decision. However, in the case where a shadow is 

15 located on a wall portion and the distance of the 

contact of the wall and the shadow with each other is 
long, the possibility that the shadow is not a focus 
candidate shadow is high. Contrarily, if the distance 
by which the wall and the shadow are in contact is 

20 short, the possibility that the shadow is a focus 
candidate shadow is high. For this reason, in a 
modification of the decision making subroutines Dl to 
D3 of Fig. 25, if the CPU 40 determines from the 
processing of the decision making subroutines Dl to D3 

25 that a shadow is located on a wall portion, the CPU 40 
determines whether the length of contact between the 
shadow and the wall portion is smaller than a 
predetermined length. If the CPU 40 determines that 



the length is smaller, the CPU 40 determines that the 
shadow is a focus candidate shadow; whereas, if the CPU 
40 determines that the length is larger, the CPU 40 
excludes the shadow from focus candidate shadows. 
5 Figs. 44a to 44c show a specific example in 

which, when the CPU 40 determines that a shadow is 
located on a wall portion, the CPU 40 determine whether 
the shadow is a focus candidate shadow from the length 
of contact between the shadow and the wall portion. As 

10 shown in Fig. 44a, in a CT image, shadows 441 and 442 
exist in contact with a wall portion. By applying the 
multi-valued image processing and the predetermines 
decision process of Figs. 5 and 6 to the CT image as 
shown in Fig. 44a, the shadows 441 and 442, as well as 

15 a shadow 443, all of which seem to be focus candidates, 
are extracted in a multi-valued image, as shown in Fig. 
44b. Both of these shadows 441 and 442 are in contact 
with the wall portion and the shadow 443 is not in 
contact therewith, so that although the shadow 443 is 

20 excluded by the decision making subroutine of Fig. 25, 
the CPU 40 cannot discriminate between the shadows 441 
and 442. However, since the distance by which the 
shadow 442 is in contact with the wall portion is 
smaller than that of the shadow 441, the possibility 

25 that the shadow 442 is a focus shadow is high. 

Accordingly, the CPU 40 finds the distances by which 
the respective shadows 441 and 442 are in contact with 
the wall portion, and determines whether each of the 



- 95 - 

distances is smaller than a predetermined value, and 
determines on the basis of the result of the decision 
whether each of the shadows is a focus candidate. 
Therefore, since the distance by which the shadow 441 
5 is in contact with the interior wall portion is larger 
than the predetermined value, the CPU 40 determines 
that the shadow 441 is not a focus candidate shadow. 
On the other hand, since the distance by which the 
shadow 442 is in contact with the wall portion is 
10 substantially smaller than the predetermined value, the 
CPU 40 determines that the shadow 442 is a focus 
candidate shadow, and, as shown in Fig. 44c, only the 
shadow 442 is finally extracted as a focus candidate 
shadow . 

15 Referring to Fig. 45a, the CPU 40 rotates a 

radius of predetermined length by about one degree at 
one time about a point in the vicinity of the center of 
a shadow 451 in the range of angle 9 from 0 degrees to 
360 degrees. During this time, the CPU 40 finds the 

20 length r at which the radius crosses the edge of the 
shadow at each angle. On the basis of this length r, 
as shown in Fig. 45b, the CPU 40 plots a curve against 
the horizontal axis showing the angle 0 and against the 
vertical axis showing the length r of the radius, and 

25 performs Fourier expansion on the curve. On the basis 
of this Fourier-expanded result, the CPU 40 generates a 
broken-line graph in which the horizontal axis shows 
frequency f and the vertical axis shows the Fourier 
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coefficient C, as shown in Fig. 45c. On the basis of 
this broken-line graph, the CPU 40 determines whether 
the shadow is a focus shadow. Namely, in this broken- 
line graph, a Fourier coefficient at a frequency fO is 
5 CO, a Fourier coefficient at a frequency fl is CI, and 
a Fourier coefficient at a frequency f2 is C2 . 
Therefore, the CPU 40 represents each of the Fourier 
coefficients as Ci and each of the frequencies as Fi, 
and finds the absolute value |fi x Ci| of the product of 

10 Ci and fi; and, further, it finds the summation 

Z |fi x Ci| of the absolute value |fi x Ci| . The CPU 4 0 
divides the summation ]>] |fi x Ci| by the absolute value 
|Ci| of the Fourier coefficient Ci, to calculate a 
determined value ff. This determined value ff is 

15 expressed by the following expression: 

f f = Z l f 1 x ci l / Z l ci l • 

The CPU 40 determines whether the shadow is a 
focus candidate shadow, according to whether this 
determined value ff is smaller than a predetermined 

20 value. In the case where the shadow is a blood vessel 
cross-sectional shadow 451, as shown in Fig. 45a, the 
Fourier coefficients of high-order frequency components 
are large in the Fourier expansion. In contrast, if 
the shadow is like a focus candidate shadow, low-order 

25 frequency components are contained in large quantities 
and high-order frequency components are small in the 



Fourier expansion. Accordingly, the CPU 40 can 
determine on the basis of the value of the determined 
value ff whether the shadow is a focus candidate shadow 
or a blood vessel cross-sectional shadow. 
Incidentally, instead of this determined value ff, a 
particular |fi x Ci| may also be used as a determined 
value . 

Figs. 4 6a to 4 6d show another embodiment of 
the decision making subroutine. In Fig. 46a, the CPU 
40 rotates a radius of predetermined length by about 
one degree at one time about the vicinity of the center 
of a shadow 461 in the range of angles from 9=0 
degrees to 9 = 360 degrees. During this time, the CPU 
40 determines a length of the portion of the radius up 
to the edge of the shadow at each angle. The minimum 
value of the determined lengths is set as r. Namely, a 
short radius r of the shadow 461 is found. The area 
(the number of constituent pixels) S of the shadow 461 
is divided by this short radius r. Namely, S/r 2 is 
found. The CPU 40 compares this value with a 
predetermined value and determines whether the shadow 
is a focus shadow. Namely, as shown in Fig. 4 6b, if a 
shadow 462 is a circle, the value of S/r 2 is tc. As 
shown in Fig. 46c, if a shadow 463 is a square, the 
value of S/r 2 is 4. As shown in Fig. 46d, if a shadow 
464 is a rectangle consisting of two squares, the value 
of S/r 2 is 8. Therefore, the shadow 464 having the 
rectangular shape as shown in Fig. 46d must be excluded 
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from focus candidate shadows. Accordingly, when the 
value of S/r 2 is smaller than 8, the shadow is selected 
as a focus candidate shadow, whereas when the value of 
S/r 2 is not smaller than 8, the shadow is excluded from 
5 focus candidate shadows. Incidentally, these values 
are one example; and in actual practice, different 
numerical values may be used. Incidentally, as the 
above-described short radius r, a value r obtained by 
dividing the area S of a shadow by a maximum radius rm 
10 of the shadow may. also be used as an effective short 
radius r. 

Incidentally, in the above-described 
embodiment, the binary image processing of Figs. 5 and 
6 is applied to a CT image to perform the processing of 

15 excluding the shadow of a blood vessel portion that is 
thinner than a predetermined value. This processing 
extracts and deletes a shadow having a predetermined 
number of pixels or less in the horizontal (X axis) or 
vertical (Y axis) direction, and so a comparatively 

20 large blood vessel which does not conform to this 

condition is not excluded. Even in the case of the 
shadow of such a blood vessel portion, an elongated 
shadow as shown in Fig. 28a can be effectively excluded 
by the decision making subroutine El of Fig. 27. 

25 However, there is a case where, if a comparatively 
large focus candidate shadow 470 and blood vessel 
shadows 471 and 472 overlap, as shown in Fig. 47a, 
these blood vessel shadows 471 and 472 cannot be 
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excluded. For this reason, in this embodiment , the 
blood vessel shadows 471 and 472, as shown in Figs. 
47a, 47b are removed by cutting through using the 
cutting processing shown in Fig. 48. 
5 First of all, in the first step S481, the CPU 

40 applies the binary image processing of Figs. 5 and 6 
to a CT image, and removes the shadow of a blood vessel 
portion that is thinner than a predetermined value. 
After this processing, in Step S482, the CPU 40 finds a 

10 temporary weighted center position of the shadow shown 
in Fig. 47a. The weighted center position may be found 
by using the above-described various methods. In Step 
S483, the CPU 40 finds a minimum length Rmin of a 
moving radius 473 in the shadow while rotating the 

15 moving radius 473 in the direction of an arrow 476. 
When the minimum length Rmin is found, in Step S484, 
the CPU 40 determines, as a cutting length L, a value 
obtained by multiplying this minimum length Rmin by a 
constant. Therefore, the cutting length L - Rmin x 

20 constant. When the cutting length L is found, in Step 
S485, the CPU 40 executes cutting of the shadows of the 
blood vessel portions on the basis of this cutting 
length L. The cutting of the shadows of the blood 
vessel portions is performed as shown in Fig. 47b. 

25 First, the CPU 40 sets decision areas 474 and 475, each 
made of the number of pixels corresponding to the 
cutting length L in the horizontal (X axis) direction 
or the vertical (Y axis) direction, and determines 



whether any of the shadows 470 to 472 is smaller than 
the decision areas 474 and 475. 

In the case of Fig. 47(b), the number of 
pixels of the cutting length L is assumed to be about 
5 12 pixels. In the case of the horizontal decision area 
474, the pixel value of a pixel xl is "1" and the pixel 
value of a pixel xc is "0". Accordingly, this decision 
area 474 does not become a cutting target, and the 
pixels xl to xc remain unchanged. On the other hand, 

10 in the case of the vertical decision area 475, since 

the pixel values of a pixel yl and a pixel yc are both 
"0", the shadow 471 located in this decision area 475 
becomes a cutting target, and the pixel values of the 
pixels yl to yc are converted to "0 M . The CPU 40 

15 executes the above-described cutting processing around 
the shadows 470 to 472. In this manner, the blood 
vessel shadows 471 and 472 are cut from the' shadows 
shown in Fig. 47a, and only the focus candidate shadow 
470 is left. Incidentally, a constant for determining 

20 the cutting length L is preferably in the range of 0.5- 
1.5. In Fig. 47b, the case where the constant is 1 has 
been described. In addition, the setting of this 
constant can also be arbitrarily changed by clicking a 
rate setting button with a mouse cursor, as shown in 

25 Fig. 49a. Furthermore, as shown in Fig. 49b, the 
cutting length may also be found on the basis of 
predetermined function processing with respect to the 
horizontal axis showing the minimum length Rmin of a 
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moving radius and the vertical axis showing the cutting 
length . 

Figs. 50a and 50b show a first modification 
of the decision making subroutine. The decision making 
5 subroutine of Figs. 50a, 50b is performed in place of 
the decision making subroutine El of Fig. 27, the 
decision making subroutine Fl of Fig. 29 and each of 
the above-described decision making subroutines, or it 
is performed in parallel with these decision making 

10 subroutines. Fig. 50a is a view showing one example of 
the case where the binary image processing of Figs. 5 
and 6 is applied to a CT image. Fig. 50b is a view 
showing on a magnified scale the portion enclosed with 
a circle 501 in the image subjected to this binary 

15 image processing, and it shows how this decision is 

made. There is a medical image in which a ground glass 
opacity focus candidate shadow, which is bound to a 
blood vessel, exists in its binary image, as shown in 
Fig. 50b. Since this shadow is, as shown, bound to the 

20 blood vessel, the shadow has a shape provided with a 
multiplicity of projections toward its periphery as 
diagrammatically shown in Fig. 50(B). Therefore, this 
shadow cannot be easily determined by any of the above- 
described decision making subroutines. 

25 For this reason, the CPU 40 finds a temporary 

weighted center position similar to the above-described 
case. The CPU 40 finds the minimum length of a moving 
radius in the shadow, while rotating the moving radius 



about the weighted center position. When this minimum 
length is found, the CPU 40 draws a circle 502 having a 
radius determined by adding a predetermined value (a 
value equivalent to the number of pixels, for example, 
5 1-5 pixels) to the minimum length. The CPU 40 measures 
the lengths (run lengths) of circular arcs and the 
number of the circular arcs in which this circle 502 
and the shadow are superposed on each other. For 
example, in the case of Fig. 50b, the respective run 

10 lengths of the circular arcs are found so that the run 
length of a circular arc plp2 between an intersection 
point pi and an intersection point p2 is defined as 
"3", the run length of a circular arc p3p4 between an 
intersection point p3 and an intersection point p4 is 

15 defined as "1", and the run length of a circular arc 
p5p6 between an intersection point p5 and an 
intersection point p6 is defined as "2". After the 
measurement of the run lengths and the counting of the 
number of the circular arcs have been completed, the 

20 CPU 40 draws another circle 503 having a radius 

determined by adding another predetermined value to the 
circle 502, and similarly counts the run lengths of 
circular arcs and the number in which this circle 503 
and the shadow are superposed on each other. In Fig. 

25 50b, only intersection points ql and q2 are shown as 
the intersection points of the circle 503 and the 
shadow . 

In this manner, the CPU 40 gradually 



increases the radius of the circle and counts the run 
lengths of circular arcs and the number thereof. Figs. 
51a and 51b show the result of this counting. Fig. 51a 
schematically shows a count memory which uses run 
5 lengths as its addresses, and Fig. 51b shows 

characteristic curves plotted against the horizontal 
axis representing the run lengths of arcs and the 
vertical axis representing the number of arcs, the run 
lengths and the number of arcs being the contents of 

10 the count memory. In the case of Fig. 51a, the count 
memory shows values, such as 15 circular arcs, each 
having a run length of "1", and 53 circular arcs, each 
having a run length of "2". A characteristic curve 
which corresponds to these values is a characteristic 

15 curve 511 in Fig. 51b. Accordingly, in the case where 
the shadow is a focus candidate shadow, since the 
number of portions projecting outward from the shadow 
is extremely large, the shadow exhibits the feature 
that an extremely large number of circular arcs of 

20 short run length exist, and the number of circular arcs 
of long run length is small. On the other hand, in the 
case where the shadow is not a focus candidate shadow, 
the shadow has a shape as shown by a characteristic 
curve 512 and exhibits the feature that circular arcs 

25 of short run length exist and circular arcs of long run 
length exist by approximately the same number, unlike 
the case of the focus candidate shadow. Accordingly, 
the CPU 40 can make a decision as to whether the shadow 



is a focus candidate shadow, by identifying the shadow 
by using the position of a peak (in the run length) of 
such a characteristic curve. In addition, the CPU 40 
may make a decision as to the shadow by using the shape 
5 of a distribution of the characteristic curve, i.e., 
half-value widths 513 and 514 and the like. 
Furthermore, the CPU 40 may provide the value of a run 
length to the input of a neural network or the like, 
and make a decision as to the shadow by using the 

10 output of the neural network. In addition, although in 
the above-described embodiment the circular arc lengths 
obtained in the case where a focus candidate shadow and 
a circle overlap are used, circular arc lengths 
obtained where a focus candidate shadow and a circle do 

15 not overlap may be used, and further, a combination of 
both circular arc lengths may also be used. Run 
lengths may also be found on the basis of whether a CT 
value is larger or smaller than a threshold value or 
whether a density gradient is larger or smaller than a 

20 threshold value. 

Incidentally, although in Fig. 50 a circle is 
used to count run lengths and the number of arcs, a 
closed curve corresponding to the shape of a shadow may 
be generated in the following manner to count run 

25 lengths and the number thereof on the basis of this 

closed curve. Namely, in the case of a shadow 520, as 
shown in Fig. 52a, the CPU 40 rotates a radius of 
predetermined length by increments of one degree about 
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a point at the vicinity of the center of the shadow 520 
in the range of an angle 6 from 0 degrees to 360 
degrees. During this time, the CPU 40 finds a length R 
at which the radius crosses the edge of the shadow at 
5 each angle. Incidentally, if a plurality of 

intersection points of the radius and the edge of the 
shadow exist, the CPU 40 selects the shortest radius. 
The CPU 40 plots a curve with the horizontal axis 
showing the angle 9 and the vertical axis showing the 

10 length R of the radius calculated in this manner. This 
curve may be as shown in Fig. 52b. This curve becomes 
a curve whose apexes and valleys are alternately 
repeated. Accordingly, the CPU 40 finds the positions 
of the respective valleys (the angle 0) , and marks them 

15 onto the shadow display. The positions of the 
respective valleys are discrete on the shadow. 
Therefore, the CPU 40 generates a closed curve 521, as 
shown in Fig. 52a, by performing the processing of 
interpolation between each of the valleys by means of a 

20 spline curve or the like. When the closed curve 521 is 
found, the CPU 40 counts the lengths of short curve 
segments (run lengths) in portions in each of which 
this closed circle 521 and the shadow 520 are 
superposed on each other, as well as the number of the 

25 curve segments, similar to the above-described case of 
Figs. 50a, 50b. After the measurement of the run 
lengths and the counting of the number of curve 
segments have been completed as to the circle 521, the 



CPU 40 draws a closed curve 522 formed by adding a 
predetermined value dR to the radius R(9) of the closed 
curve 521, and similarly counts the run lengths and the 
number of curve segments in the circle 522. In this 
5 manner, the CPU 40 gradually increases the 

predetermined value dR and sequentially counts the run 
lengths and the number of the curve segments. 
Accordingly, since a count memory and characteristic 
curves similar to those shown in Figs. 51a, 51b are 

10 obtained, the CPU 40 can make a decision as to whether 
the shadow is a focus candidate shadow, similar to the 
above-described case. In addition, although in the 
above-described embodiment the lengths of the curve 
segments obtained in the case where a focus candidate 

15 shadow and a circle overlap are used, the lengths of 
curve segments obtained in the case where a focus 
candidate shadow and a circle do not overlap may be 
used, and, further, a combination of both may also be 
used. Curve segments may also be found on the basis of 

20 whether a CT value is larger or smaller than a 

threshold value or whether a density gradient is larger 
or smaller than a threshold value. 

In the above description, curve segments of a 
closed curve are used as a feature by which the 

25 decision is made, but a Fourier transform of shadow 
densities applied to a closed curve can also be used. 

Figs. 53 and 54 are views showing a second 
modification of the decision making subroutine. The 
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decision making subroutines of Figs. 53a to 53c and 54a 
to 54c are performed in place of the decision making 
subroutine El of Fig. 27, the decision making 
subroutine Fl of Fig. 29 and each of the above- 
5 described decision making subroutines, or they are 
performed in parallel with these decision making 
subroutines. Figs. 53a to 53c shows processing to be 
performed on a blood vessel cross-sectional shadow 
generated by applying the binary image processing of 

10 Figs. 5 and 6 to a CT image, and Figs. 54a to 54c shows 
processing to be performed on a focus candidate shadow. 
There is a case where even if the binary image 
processing of Figs. 5 and 6 is applied to a CT image to 
remove the shadow of a blood vessel portion that is 

15 thinner than a predetermined value, there may remain a 
blood vessel cross-sectional shadow 530 which seems to 
be a focus shadow, as shown in Fig. 53a. Accordingly, 
the blood vessel cross-sectional shadow 530 as shown in 
Fig. 53a must be excluded from focus candidates. For 

20 this reason, in this modification of the decision 

making subroutine, this blood vessel cross-sectional 
shadow 530 is extracted and excluded. Namely, to 
exclude the blood vessel cross-sectional shadow 530 
from focus candidates, notice is taken of the density 

25 distribution in the shadow. Namely, in the case of the 
shadow 530 of a blood vessel cross-section, in a liver 
or the like, the contours of density in the shadow 
exhibit a simple form having one peak, as shown in Fig. 
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53a. On the other hand, in the case of a focus 
candidate shadow 540, as shown in Fig. 54a, there 
appear complicated contours having a plurality of peaks 
in the shadow. Accordingly, as to these shadows, the 
CPU 40 finds continuous segments (run lengths) along 
which there are continuously positive or negative 
values of density gradient, obtains a subtraction 
result, or performs a differential or other processing 
between the CT values of one pixel and the pixel 
adjacent in the x axis direction from left to right and 
in the y axis direction from top to bottom, as shown in 
Figs. 53b and 53c and Figs. 54a and 54b. For example, 
as shown in Fig. 53b, the CPU 40 computes the density 
gradient of each pixel in order from the left-hand 
side, on a straight area 531 along a shadow in the X 
axis direction. Assuming that the density of an 
original image, such as a CT image corresponding to the 
shadow 530 of Fig. 53b is f[y][x], a density gradient 
g[y][x] of each pixel is found by a difference between 
the previous and next pixels, as expressed by the 
following formula : 



g[y][x] = f[y][x + 1] - f[y][x - 1] . 



When the computation of the density gradients 
in the straight area 531 is completed in this manner, 
the CPU 40 sequentially shifts this straight area in 
the y axis direction to compute density gradients. 



Fig. 53b diagrammatically shows the density gradients 
in the X axis direction in the case of each of the 
straight areas 531 and 532. Fig. 53c diagrammatically 
shows the density gradients in the Y axis direction in 
5 the case of each of the straight areas 533 and 534. 
The CPU 40 finds the positive and negative run length 
segments in each of the straight lines on the basis of 
these density gradients. For example, in the case of 
the straight area 531, the positive run length is "11" 

10 and the negative run length is "4". In the case of the 
straight area 532, the positive run length is "7" and 
the negative run length is "7". In the case of the 
straight area 533, the positive run length is "6" and 
the negative run length is "6". In the case of the 

15 straight area 532, the positive run length is "6" and 
the negative run length is "5". In this manner, the 
CPU 40 counts the positive and negative run lengths 
over the whole of the shadow 530. The CPU 40 similarly 
finds the density gradients of each straight area of 

20 the focus candidate shadow 540 as shown in Figs. 54a 
and 54b, and counts positive and negative run lengths 
on the basis of the density gradients. In the case of 
a straight area 541 of Fig. 54a, the positive run 
lengths are "11" and "2" and the negative run lengths 

25 are "3" and "4". In the case of a straight area 542, 
the positive run lengths are "5" and "2" and the 
negative run lengths is "2" and "4". In the case of a 
straight area 543, as seen in Fig. 4b, the positive run 



lengths are "6", "1" and "1" and the negative run 
lengths are "3", "2" and "3". In the case of a 
straight area 544, the positive run lengths are "5", 
"2" and "2" and the negative run lengths are "2", "2" 
5 and "3". It can be seen from this fact that the focus 
candidate shadow has shorter length of each run length 
segment and greater number of run length segments. 

Fig. 54c shows the relationship between the 
length and the number of run length segments which are 

10 calculated in the shadow 530a of Fig. 53 and the focus 
candidate shadow 540 of Fig. 54a. As is apparent from 
the curves shown in Fig. 54c, the case of the focus 
candidate shadow exhibits a tendency to have a peak in 
a number of run length segments where the lengths are 

15 comparatively small, while the case of the blood vessel 
cross-sectional shadow or the like exhibits a tendency 
to have a peak where the lengths are comparatively 
large. Accordingly, by utilizing these tendencies, the 
CPU 40 can efficiently exclude the blood vessel cross- 

20 sectional shadow, as shown in Figs. 53a to 53c. 

Incidentally, in the description of this modification, 
reference has been made to the case where a density 
gradient is found from the difference between the 
previous and next pixels, but the density of a pixel 

25 may be compared with a predetermined threshold value to 
determine the density gradient of "+" or "-" according 
to the magnitude of the density. As this threshold 
value, the average value of densities in the entire 
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range of a shadow may also be used. Incidentally, in 
the above-described embodiment, reference has been made 
to the case where density gradients in the X axis 
direction and the Y axis direction are calculated, but 
5 density gradients as to one arbitrary direction may be 
found, or density gradients may also be found as to a 
plurality of directions, such as the X axis direction, 
the Y axis direction and a direction crossing either of 
these directions at 45 degrees. 

10 The above description has referred to the 

case where, in the decision making subroutines Dl to D3 
of Fig. 25, a decision is made as to whether a shadow 
is located on a wall portion; and, further, in Figs. 
44a to 44c, a decision is made as to whether the shadow 

15 is a focus candidate shadow, on the basis of the length 
of contact between the shadow and the wall portion. 
However, there is a case where shadows 551 and 552, 
which are in contact with a wall portion, exist in a CT 
image, as shown in Fig. 55a. Since the distance of the 

20 boundary where the shadow 551 is in contact with the 
inside of the wall portion is much larger than a 
predetermined value, it is determined that the shadow 
551 is not a focus candidate shadow. However, the 
shadow 552 is not a shadow of a cancer or the like, but 

25 is a cancer-accompanying shadow which is concomitant 

with a cancer (invagination of a pleural membrane), and 
the cancer-accompanying shadow is characterized by an 
elongated shape perpendicular to the pleural membrane. 
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Therefore, the possibility that this shadow 552 is 
excluded from focus candidate shadows is very high. 
However, it is known that an indistinct shadow like 553 
in the vicinity of a cancer accompanying shadow, for 
5 instance, in contact with a tip of the shadow 552, as 
shown in Fig. 55a, is a focus candidate. This cancer- 
accompanying shadow 553 cannot be easily extracted by 
the above-described processing. For this reason, in 
this embodiment, this cancer-accompanying shadow 552 is 

10 extracted, and the cancer-accompanying shadow 552 is 
displayed in such a manner as to be enclosed with a 
large marker (a circle or an ellipse) , thereby 
indicating that a shadow acting like a focus exists 
near the cancer-accompanying shadow 552. In this 

15 embodiment, the cancer-accompanying shadow detection 

processing shown in Fig. 56 is executed to detect such 
a cancer-accompanying shadow. 

[Step S551] First, since a shadow 550 and 
the shadows 551 and 552, all of which seem to be focus 

20 candidate shadows, are extracted in a multi-valued 
image, as shown in Fig. 55b, the CPU 40 determines 
whether these shadows 550, 551 and 552 are in contact 
with the wall portion. If the CPU 40 determines that 
each of the shadows 550, 551 and 552 is in contact 

25 (yes), the CPU 40 proceeds to the next Step S552; 

whereas, if the CPU 40 determines that a shadow 550, 
551 or 552 is not in contact (no) , the CPU 40 proceeds 
to Step S554 and deletes the corresponding shadows. 



Since the shadow 550 is not in contact, the shadow 550 
is excluded from focus candidates through the shadow 
deletion processing of. Step S554. 

[Step S552] Then, the CPU 40 determines the 
5 proportion in which each of the shadows is in contact 
with the wall portion of the pleural membrane, i.e., 
whether each of their contact lengths is smaller than a 
predetermined value. If the CPU 4 0 determines that 
each of the contact lengths is smaller (yes) , the CPU 

10 40 proceeds to the next Step S553; whereas, if the CPU 
40 determines that part of the contact lengths is not 
smaller (no) , the CPU 40 deletes the corresponding 
shadow. Since the length of contact of the shadow 551 
with the wall portion is larger than the predetermined 

15 value, the shadow 551 is deleted through the shadow 

deletion processing of Step S554. Since the length of 
contact of the shadow 552 with the wall portion is much 
smaller than that of the shadow 551, the CPU 40 
proceeds to the next Step S553. 

20 [Step S553] The CPU 40 extracts a cancer- 

accompanying shadow from corresponding shadows. 
Namely, the shadow 442 of Fig. 44a and the shadow 552 
of Fig. 55a corresponds to shadows, each of which is in 
contact with the wall portion in a proportion smaller 

25 than the predetermined value. Among such shadows, a 
cancer-accompanying shadow is a shadow which is too 
elongated to be determined as a focus candidate shadow. 
Therefore, the CPU 40 extracts as a cancer-accompanying 



shadow a shadow which is in contact with the wall 
portion in a proportion smaller than the predetermined 
value and is excluded from focus candidate shadows. 
Accordingly, as shown in Fig. 55c, the shadow 552 is 
5 extracted as a cancer-accompanying shadow. On the 

other hand, the shadow 442 of Fig. 44a is extracted as 
a focus candidate shadow. 

[Step S554] The CPU 40 determines the 
shadows which have been determined as "no" in Step S551 

10 and Step S552. 

[Step S555] The CPU 40 displays a large 
marker 570 (a circle or an ellipse) in such a manner as 
to superpose the marker 570 on the original image to 
enclose the cancer-accompanying shadow detected in Step 

15 S553, i.e., a object indicating a focus, as shown in 

Fig. 57. Incidentally, the size of this marker 570 can 
be arbitrarily changed by a scale setting ' button 
displayed at the bottom right. The doctor can perform 
an examination as to whether a focus shadow exists by 

20 visually inspecting the portion enclosed by this marker 
570. 

Figs. 58a to 60b are views showing a third 
modification of the decision making subroutine. The 
decision making subroutine of Figs. 58a to 60b is 
25 performed in place of the decision making subroutine El 
of Fig. 27, the decision making subroutine Fl of Fig. 
29 and each of the above-described decision making 
subroutines, or it is carried out in parallel with 



these decision making subroutines. First of all, the 
CPU 40 applies the binary image processing of Figs. 5 
and 6 to a CT image and finds a temporary weighted 
center position. The weighted center position may be 
5 found by using the above-described various methods. 

The CPU 40 rotates a radius 581 of predetermined length 
by increments of 5 degrees in the range of angle 0 from 
0 degrees to 360 degrees about the temporary weighted 
center position in the direction of an arrow 583. The 

10 increment of rotation may be any appropriate value 

other than 5 degrees. The CPU 40 finds a variance or 
standard deviation SD0 of CT values of a shadow located 
on the radius, while rotating the radius. 

The result obtained in this manner is plotted 

15 in graphs as shown in Figs. 58b and 58c. The variance 
or standard deviation SD0 of Fig. 58b is that of the 
focus candidate shadow 540 shown in Fig. 54a. The 
variance or standard deviation SD0 of Fig. 58c 
corresponds to the blood vessel cross-sectional shadow 

20 530 shown in Fig. 53a. The focus candidate shadow 540 
exhibits complicated contours having a plurality of 
peaks, as described previously. The variance or 
standard deviation SD0 assumes various complicated 
values for the respective angles, as shown in Fig. 58b, 

25 according to the complicated contours. On the other 
hand, the blood vessel cross-sectional shadow 530 
exhibits simple contours having one peak. The variance 
or standard deviation SD0 also assumes simple values 
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which do not greatly vary among the angles, as shown in 
Fig. 58c. Accordingly, the CPU 40 can determine 
whether the shadow is a focus candidate shadow or a 
blood vessel cross-sectional shadow, on the basis of 
5 the graphs of the variance or standard deviation SD0, as 
shown in Figs. 58b and 58c. 

Incidentally, the CPU 40 may also find a 
secondary variance or standard deviation of the 
variance or standard deviation SDO of Figs. 58b and 58c 

10 to determine whether the shadow is a focus candidate 
shadow or blood vessel cross-sectional shadow, 
according to whether the secondary variance or standard 
deviation is larger or smaller than a predetermined 
value. In addition, as shown in Figs. 59a to 59c, the 

15 CPU 40 may divide each shadow into areas to find a 
variance or standard deviation as to each of the 
divided areas. In the case of Fig. 59a, the CPU 40 
divides a shadow into upper and lower shadows along a 
horizontal line passing through the middle of the 

20 shadow, and finds a variance or standard deviation SD-U 
of CT values of the upper shadow and finds a variance 
or standard deviation SD-D of CT values of the lower 
shadow; and, further, it finds the secondary variance 
or standard deviation of both as a key feature to be 

25 used for making a decision as to the shadow. 

Incidentally, the CPU 40 may also use as a key 
determining feature the difference between the 
variances or standard deviations SD-U and SD-D of the 



upper and lower shadows or the absolute value of the 
difference. In the case of Fig. 59b, the CPU 40 
divides a shadow into four quadrants along horizontal 
and vertical lines passing through the shadow, and 
5 finds variance or standard deviations SD-1 to SD-4 of 
CT values of each of the quadrants as a feature 
quantity to be used for making a decision as to the 
shadow. In the case of Fig. 59c, the CPU 40 divides a 
shadow into areas arranged at equal intervals in the 

10 vertical direction, and finds variance or standard 
deviations SD-1 to SD-7 of CT values of each of the 
divided areas; and, further, it finds a secondary 
variance or standard deviation of these variance or 
standard deviations SD-1 to SD-7 as a key feature 

15 quantity to be used for making a decision as to the 

shadow. Incidentally, the CPU 40 may divide the shadow 
into areas arranged at equal intervals in the 
horizontal direction . 

Figs. 58a to 58c and 59a to 59c show the case 

20 where the CPU 40 uses variance or standard deviation of 
the shadow to make a decision as to whether a shadow is 
a focus candidate shadow or a blood vessel cross- 
sectional shadow. As shown in Figs. 60a and 60b, the 
CPU 40 may also make a decision as to a shadow by using 

25 a variance or standard deviation of the shadow and a 

variance or standard deviation of a predetermined area 
along the periphery of the shadow. Namely, in the case 
where the periphery of a shadow is defined by a moving 
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radius circle R(0), as shown in Figs. 60a and 60b, the 
difference from a variance or standard deviation in the 
area R(G) to R(9) + dR outward by a predetermined 
distance dR from this moving radius circle R(0) is found 
5 as a feature quantity, whereby it is possible to 

discriminate between the blood vessel cross-sectional 
shadow shown in Fig. 60a and the focus candidate shadow 
shown in Fig. 60b. In the case of the blood vessel 
cross-sectional shadow shown in Fig. 60a, since the 

10 area R(G) to R(9) + dR traverses the blood vessel cross- 
sectional shadow, the variance or standard deviation 
assumes a comparatively large value. In the case of 
the focus candidate shadow shown in Fig. 60a, since a 
substantial part of the area R(9) to R(9) + dR traverses 

15 a portion where the shadow does not exist, the variance 
or standard deviation, assumes a comparatively small 
value. Accordingly, the CPU 40 finds the difference 
between a variance or standard deviation inside of the 
shadow and the variance or standard deviation in the 

20 area R(9) to R(9) + dR as a key feature quantity to be 
used for discriminating between the focus candidate and 
blood vessel shadow. In addition, the CPU 40 may also 
set threshold values, respectively, for this key 
feature and for the variance or standard deviation of 

25 the area R(9) to R(9) + dR, respectively, to make such a 
decision. Furthermore, this feature quantity or the 
variance or standard deviation of the area R(9) to R(9) 
+ dR may be used as an input value for Mahalanobis 
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distance, Euclidean distance, neural networks and the 
like, and the CPU 40 may make such a decision by using 
the obtained result. 

In the above-described embodiment, as a 
5 display method for the case where a CT image having an 
extracted focus candidate shadow and a marker are 
displayed for the operator (doctor) , reference has been 
made to a method of displaying, at the same time, a 
detection result image in which a focus candidate 

10 shadow is indicated by a marker, as shown in Fig. 38 

and a magnified image which shows the marker portion on 
an magnified scale,, as well as a method of providing 
display in various modes as shown in Figs. 39 to 43. 
In these methods, in the case where the operator 

15 (doctor) arbitrarily selects a portion desired to be 

displayed, with a mouse cursor or the like, the CPU 40 
may also display focus candidate shadows in the order 
of their locations relative to the selected portion, 
from closest to farthest. Details of this focus 

20 candidate shadow display processing will be described 
below with reference to Figs. 61a, 61b and 62. 

[Step S621] The CPU 40 sequentially displays 
combined images, each made up of a marker and a 
tomographic image as shown in Fig. 39, 41 or 42, in 

25 accordance with a display mode selected by the standard 
mode selecting button on the standard picture of Fig. 
38. 

[Step S622] The CPU 40 determines whether a 
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mouse has been clicked at an arbitrary position on a 
combined image being displayed. If the decision result 
is yes, the CPU 40 proceeds to the next Step S623, 
whereas if the decision result is no, the CPU 40 
5 returns to Step S621. In Step S621, the display of a 
combined image according to the display mode is 
continued. Namely, this means that when a mouse 
pointer 611 lies at a predetermined position on the 
combined image as shown in Fig. 61a, a decision is made 
10 as to whether the button of the mouse has been clicked. 

[Step S623] Since it has been determined in 
Step S622 that the mouse has been clicked, the CPU 40 
determines whether a focus candidate shadow exists 
within a circle of radius D from the position of the 
15 mouse pointer. Namely, in the case of Fig. 61a, a 

decision is made as to whether a focus candidate shadow 
exists within a dashed-line circle of radius D centered 
at the mouse pointer 611. 

[Step S624] Since it has been determined in 
20 the decision of Step S623 that a focus candidate shadow 
does not exist within the circle of radius D centered 
at the mouse pointer, the CPU 40 displays "No Focus 
Candidate Shadow Exists". Since a "CONTINUE" button 
for determining whether the current display is to be 
25 continued without modification and an "END" button for 
bringing display to an end are included in the display, 
the CPU 40 determines whether this "END" button has 
been manipulated with a click. If the decision result 



is yes (the "END" button has been clicked), the CPU 40 
brings the processing to an end, whereas if the 
decision result is no (the "CONTINUE" button has been 
clicked), the CPU 40 returns to Step S621. 

[Step S625] Since it has been determined in 
the decision of Step S623 that a focus candidate shadow 
exists within the circle of radius D centered at the 
mouse pointer, the CPU 40 sequentially displays images 
in which tomographic images of the focus candidate 
shadow and markers are combined. In the case of Fig. 
61a, the focus candidate shadows of the image a and the 
image c corresponds to the shadow which exists within 
the dashed-line circle of radius D. The focus 
candidate shadows of the images b and the images c of 
Figs. 41 and 42 correspond to the shadow which exists 
within the dashed-line circle of radius D. 
Accordingly, as shown in Fig. 61b, the images of the 
existing focus candidate shadows are sequentially 
displayed in the circle of radius D. In Fig. 61b, the 
images b of Figs. 41 and 42 are displayed. Although 
not shown, a "NEXT button" is displayed, and when it is 
clicked, the next image c is displayed. There is also 
a special case where the radius D is set to be larger 
than such an image, and when a mouse is clicked with no 
marker being displayed, all corresponding markers are 
displayed in response to the click. 

[Step S626] The CPU 40 determines whether 
the mouse has been clicked at an arbitrary position on 
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the combined image being displayed. If the decision 
result is yes (if the mouse is clicked) , the CPU 40 
returns to the previous Step S623; whereas, if the 
decision result is no, the CPU 40 returns to Step S625. 
5 In Step S625, the display of the focus candidate shadow 
is continued. When another position is clicked by the 
mouse pointer, similar processing is performed in this 
step according to whether a focus candidate shadow 
exists within a circle of radius D centered at the 

10 mouse pointer. In the case where the same position is 
clicked, similar to the case where the aforementioned 
"NEXT button" is clicked, the next image c is 
displayed. To provide such a display, information on x 
coordinates and y coordinates indicating where 

15 extracted focus candidate shadows are located on the 
image is stored on a predetermined memory space. 

Fig. 63a, 63b and Fig. 64a, 64b are views 
showing a fourth modification of the decision making 
subroutine. Each of the decision making subroutines of 

20 Fig. 63a, 63b and Fig. 64a, 64b is performed in place 
of the decision making subroutine El of Fig. 27, the 
decision making subroutine Fl of Fig. 29 and each of 
the above-described decision making subroutines, or it 
is performed in parallel with these decision making 

25 subroutines. Fig. 63a is a view showing a part of a CT 
image of the case where a plurality of needle- or line- 
shaped shadows 631 to 639, called spicules, appear in 
the periphery of a malignant cancer shadow 630. 
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The cancer shadow 630 is a shadow of 
comparatively low density, and it is difficult to 
identify. In contrast, the shadows 631 to 639 are 
shadows of high density and are easy to identify, but 
5 they have the disadvantage that they are easily 

mistaken for shadows of blood vessels. When the binary 
image processing of Figs. 5 and 6 is applied to the CT 
image including the spicules as shown in Fig. 63a, the 
cancer shadow 630 of low density is not extracted and 

10 only the needle- or line-shaped shadows 631 to 639 are 
extracted, as shown in Fig. 63b. There is a case where 
these spicula shadows 631 to 639 are mistaken for the 
shadow of a blood vessel portion and are excluded. 
Therefore, it is necessary to determine whether the 

15 shadows 631 to 639 shown in Fig. 63b are spicula 

shadows. For this reason, in this embodiment, the CPU 
40 discriminates between such spicula shadows and blood 
vessel shadows; and, in the case of the spicula 
shadows, the CPU 40 finds the weighted center position 

20 of the shadows and displays the weighted center 
position with a marker. 

First, the CPU 40 applies the binary image 
processing of Figs. 5 and 6 to the CT image and finds a 
temporary weighted center position of the shadows. The 

25 weighted center position may be found by using the 

above-described various methods. The CPU 40 rotates a 
straight line about the temporary weighted center 
position and finds a straight line whose portion 
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crossing each the shadows is the longest, i.e., the 
long length of each of the shadows, and finds the 
positions (two points) at which this long length line 
crosses the edge of its shadow. Fig. 64a is a view 
5 showing the state where the long diameter of each of 
the shadows 631 to 639 is found and the intersections 
of the long diameter and each of the shadows are found. 
As is apparent from Fig. 64a, two intersections are 
found on each of the shadows 631 to 639. Intersections 

10 631A and 631B exist on the shadow 631, and 

intersections 632A and 632B exist on the shadow 632. 
Similarly, intersections 633A to 639A and 633B to 639B 
exist on the respective shadows 633 to 639. 

The CPU 40 arranges the thus-obtained 

15 intersections 631A to 639A and 631B to 639B on a pixel 
memory space, as shown in Fig. 64b, and assigns 
straight strips 631c to 639c of predetermined width, 
which respectively connect the intersections 631A and 
639A to the intersections 631B to 639B, on the pixel 

20 memory space cleared to zero. The CPU 40 adds "1" to 
pixels which correspond to these straight strips 631c 
to 639c, for each of the straight strips 631c to 639c. 
Namely, the CPU 4 0 adds "1" to a pixel memory 
corresponding to an area through which the strip-shaped 

25 straight line 631c passes, and adds "1" to a pixel 
memory corresponding to an area through which the 
straight strip 632c passes. Similarly, the CPU 40 adds 
"1" to a pixel memory corresponding to each of the 
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areas through which the respective straight strips 633c 
to 639c pass. In this manner, the values of the 
respective pixel memories at locations corresponding 
the areas through which the respective straight strips 
5 631c to 639c pass are increased. 

In the case of Fig. 64b, the straight strips 
631c to 639c concentrically pass through a portion 
enclosed by a circle 640, so that the value of the 
pixel memory of this portion becomes large. Thus, the 

10 CPU 40 extracts a portion in which the value of its 
pixel memory is, for example, 4 or more, and defines 
the portion as the weighted center position of the 
spicula shadows. Incidentally, if portions, in each of 
which the value of its pixel memory is 4 or more, are 

15 close to each other, the portion having the higher 

value is defined as the weighted center position. When 
this weighted center position is found, the CPU 40 
displays a marker 641 centered about the weighted 
center position, as shown in Fig. 63b. In this manner, 

20 a malignant cancer shadow having spicula shadows easily 
mistaken for blood vessel shadows can be displayed as a 
focus candidate shadow. 

Figs. 65 and 66a to 66f are views showing a 
modification of each of the decision making subroutine 

25 El of Fig. 27 and the decision making subroutine Fl of 
Fig. 29, and they show a processing method for 
extracting and excluding a blood vessel cross-sectional 
shadow. The processing of Figs. 65 and 66a to 66f may 
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be executed in parallel with the decision making 
subroutine El of Fig. 27 or the decision making 
subroutine Fl of Fig. 29. Normally, there is a case in 
which a CT image of a lung portion (lung region) 
5 captures part of the blood vessels which extend so as 
to spread radially. Accordingly, in this embodiment, 
recognizing that some blood vessels extend radially, 
the CPU 40 extracts and excludes such blood vessel 
cross-sectional shadows. Namely, in this embodiment, 

10 in the case where blood vessels extend radially as 

shown in Fig. 65, the CPU 40 compares mutually adjacent 
tomographic images of predetermined slice thickness to 
determine whether the tomographic images are blood 
vessel cross-sectional shadows. 

15 As to the blood vessels which extend 

radially, as shown in Fig. 65, tomographic images 
respectively corresponding to planes 651 to 653 are 
photographed, as shown in Fig. 65. As to the plane 
651, blood vessel cross-sectional shadows 651A and 651B 

20 are photographed as tomographic images, as shown in 
Fig. 66a. As to the plane 652, blood vessel cross- 
sectional shadows 652A and 652B are photographed as 
tomographic images, as shown in Fig. 66b. As to the 
plane 653, blood vessel cross-sectional shadows 653A, 

25 653B and 653C are photographed as tomographic images, 

as shown in Fig. 66c. In the tomographic images of the 
radially extending blood vessels, the blood vessel 
cross-sectional shadows sequentially change in position 
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and size. Accordingly, the CPU 40 superposes mutually 
adjacent tomographic images, and determines whether the 
shadows are blood vessel cross-sectional shadows, on 
the basis of the manner of the changes in the positions 
5 and the sizes of the shadows. 

Fig. • 66d shows tomographic images 
corresponding to the plane 651 and the plane 652, which 
are adjacent to each other, i.e., a superposition of 
Fig. 66a and Fig. 66b. Fig. 66e shows tomographic 

10 images corresponding to the plane 652 and the plane 653 
which are adjacent to each other, i.e., a superposition 
of Fig. 66b and Fig. 66c. For ease of illustration, 
the blood vessel cross-sectional shadows 652A and 652B 
of Fig. 66b are represented by dashed lines in Figs. 

15 66d and 66e. As shown in Fig. 66a, the blood vessel 

cross-sectional shadow 651A and the blood vessel cross- 
sectional shadow 652A are partly superposed on each 
other. In addition, the blood vessel cross-sectional 
shadow 651B and the blood vessel cross-sectional shadow 

20 652B are partly superposed on each other. In the case 
where the shadows of both tomographic images are partly 
superposed, both are deleted as blood vessel cross- 
sectional shadows indicative of part of the radially 
extending blood vessels. In the case of the blood 

25 vessel cross-sectional shadow 652A and the blood vessel 
cross-sectional shadow 653A of Fig. 66e, since they are 
partly superposed, both shadows are deleted as blood 
vessel cross-sectional shadows. In the case of the 



blood vessel cross-sectional shadow 652B and the blood 
vessel cross-sectional shadows 653B and 653C of Fig. 
66e, the blood vessel cross-sectional shadows 653B and 
653C branch off from the blood vessel cross-sectional 
5 shadow 652B, and the blood vessel cross-sectional 

shadow 653B is partly superposed on the blood vessel 
cross-sectional shadow 652B, but the blood vessel 
cross-sectional shadow 653C is not partly superposed on 
the blood vessel cross-sectional shadow 652B. 

10 Accordingly, in this case, the blood vessel cross- 
sectional shadow 652B and the blood vessel cross- 
sectional shadow 653B become objects to be deleted as 
blood vessel cross-sectional shadows, but the blood 
vessel cross-sectional shadow 653C does not become an 

15 object to be deleted. Incidentally, in the case where 
the respective blood vessel cross-sectional shadows 
652A and 652B are superposed on shadows 661 and 662 in 
proportions more than a predetermined proportion, as 
shown in Fig. 66f, all of these shadows are not 

20 detected as focus candidate shadows, and become objects 
for another decision. Incidentally, these proportions 
are calculated for the respective shadows, and the area 
of superposition is divided by the area of each of the 
superposed shadows, and the larger value is adopted. 

25 Namely, in the case of the blood vessel cross-sectional 
shadow 652A and the shadow 661, the proportion found 
when the area of their superposition is divided by the 
area of the blood vessel cross-sectional shadow 652 and 
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the proportion found when the area of the superposition 
is divided by the area of the shadow 661 differ from 
each other, and the result of division by the shadow 
661 of smaller area is adopted. Incidentally, the 
5 proportion of the superposition can be arbitrarily set 
as a parameter. 

Incidentally, in X-ray CT devices and the 
like, there is a case where data of projection on an 
area in all directions cannot be obtained and a 

10 tomographic image must be reconstructed. This case is 
called a partial volume effect. Even in a decision as 
to whether a shadow due to this partial volume effect 
is mistakenly detected, it is effective to find a 
correlation of mutually adjacent images. In the case 

15 of the partial volume effect, since a shadow of high 

density is imaged in adjacent areas, the proportion of 
pixels which assumes a larger value than a preset 
particular CT value in the previously detected area and 
the corresponding area (the same position) of its 

20 adjacent image can be used for the decision. 

Figs. 67a to 67d and 68 are views showing a 
fifth modification of the decision making subroutine. 
The decision making subroutine of Figs. 67a to 67d and 
68 uses three sets of medical images (axial images, 

25 sagittal images and coronal images) which are mutually 
perpendicular, and detection is made as to an abnormal 
shadow in each of the three sets of medical images; 
and, if there is a correlation between positions where 



- 130 - 

detected shadows exist, the shadows are displayed or 
recorded as focus candidate shadows. Fig. 67a shows 
the concept of coaxial planes corresponding to coaxial 
images. Fig. 67b shows one example of a coaxial image 
5 corresponding to the coaxial planes shown in Fig. 67a. 
Fig. 67c shows sagittal planes corresponding to 
sagittal images as well as coronal planes. In Fig. 
67c, the sagittal planes are shown by solid lines, and 
the coronal planes are shown by dashed lines. Fig. 67d 
10 shows one example of a sagittal image corresponding to 
the sagittal plane shown in Fig. 67c. Incidentally, a 
coronal image corresponding to the coronal planes is 
omitted. 

The CPU 40 executes the above-described 
15 decision making subroutine on the basis of two kinds of 
images, the axial image and the sagittal image. As a 
result, it is assumed that focus candidate shadows 671 
and 672 are detected on the axial image of Fig. 67b and 
a focus candidate shadow 673 is detected on the 
20 sagittal image of Fig. 67d. Fig. 68 shows the contents 
of a memory which stores data, such as position 
information as to the detected focus candidate shadows 
671 and 673. The data stored in the memory are made up 
of the total of shadows and information as to each of 
25 the shadows. Information as to the focus candidate 
shadows 671 and 673 is made up, giving the position 
coordinates (X, Y, Z) of each of the shadows and the 
area and the maximum and minimum lengths of each of the 
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shadows, as well as other information. The position 
coordinates of the focus candidate shadow 671 on the 
axial image are (XI, Yl) , and the position coordinates 
of the focus candidate shadow 672 on the axial image 
5 are (X2, Y2) . In addition, the position coordinates of 
the focus candidate shadow 673 on the sagittal plane 
are (Zl, Yl + 5) . 

It is assumed here that the z-axis coordinate 
is not clearly identified on the axial plane and the X- 

10 axis coordinate is not clearly identified on the 
sagittal plane. In this case, when the position 
coordinates (XI, Yl) of the focus candidate shadow 671 
and the position coordinates (Zl, Yl + 8) of the focus 
candidate shadow 671 are compared with each other, 

15 their Y-axis coordinates are found to approximate each 
other. The Y-axis difference between the focus 
candidate shadow 671 and the focus candidate shadow 673 
is 8. If this difference 8 is smaller than a 
predetermined value A, it is determined that both 

20 shadows 671 and 673 lie at the same position 

coordinates and are the same focus candidate shadow, 
and the shadows 671 and 673 are left as a focus 
candidate shadow. On the other hand, if the difference 
8 is smaller than the predetermined value A, it is 

25 determined that both shadows 671 and 673 lie at 

different position coordinates, and the shadows 671 and 
673 are deleted from focus candidate shadows. Since 
nothing on the sagittal plane corresponds to the 



position coordinates (X2, Y2 ) of the focus candidate 
shadow 672, the focus candidate shadow 672 in this case 
is regarded as false and is deleted- Incidentally, in 
this embodiment, the decision is made according to 
5 whether the position coordinates of shadows are the 

same, but in the case where the position coordinates of 
shadows are regarded as the same, a decision as to 
whether both shadows are the same may be made on the 
basis of the "areas", the "maximum lengths", the 

10 "minimum lengths" and the like of the shadows . 

Fig. 69 shows the case where a CT image 
having an extracted focus candidate shadow and a marker 
are displayed to the operator (doctor) together with a 
focus candidate shadow photographed and extracted in 

15 the past. Fig. 69a is a view showing one example of a 
picture which displays focus candidate shadows detected 
on the basis of a CT image photographed the latest, as 
well as markers. Fig. 69b shows one example of a 
picture which displays a marker corresponding to a 

20 focus candidate shadow photographed and extracted, for 
example, one year ago in such a manner that the marker 
is superposed on the image of Fig. 69a at the same 
time. In Fig. 69b, the marker corresponding to the 
focus candidate shadow extracted in the past is shown 

25 by a square. In addition, a figure or a character 

indicating that circular markers 691 and 692 denote the 
latest photographed objects is displayed at the top 
left of the picture, while a figure or a character 
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indicating that a square marker 693 denote the past 
(previous) photographed object is displayed at the 
bottom left of the picture. Features, such as the 
coordinates and the size of the focus candidate shadow 
5 photographed and extracted in the past, are recorded on 
a magnetic disk in the format shown in Fig. 68, and a 
marker corresponding to the past focus candidate shadow 
may be displayed on the basis of these features. For 
example, in the case where CT images are photographed 

10 and subjected to cancer detection processing at 

intervals of one year, when the detection result of 
this year and the detection result of last year are 
displayed in a superimposed manner, if a shadow newly 
appears at a location where no shadow existed last 

15 year, a doctor can be made to recognize that the 

possibility that the shadow is that of a cancer is 
high. Incidentally, the previous date of photography 
and the like may also be displayed in association with 
the marker. In addition, if there exist a plurality of 

20 dates of photography, the manner of display, such as 
the colors, the shapes and the like of markers, may 
also be changed for the respective dates of 
photography. 

Figs. 70a, 70b and 71a, 71b are views showing 

25 a modification of the manner of display of a marker. 
In the above description of the embodiment, reference 
has been made to the case where the shape of a marker 
is displayed as a circle or an ellipse. In Fig. 70a, 



the direction of a long diameter 701 indicative of the 
maximum length of a focus candidate shadow 700 and the 
direction of a long axis 703 of an elliptical marker 
702 are made coincident with each other, and the 
5 elliptical marker 702 is displayed to surround the 
focus candidate shadow 700. Since the marker is 
displayed along the shape of the shadow, the shadow is 
easy to recognize. Incidentally, the length of the 
long axis of the elliptical marker 702 may use the 

10 value obtained by multiplying the long diameter 701 of 
the focus candidate shadow 700 of the focus candidate 
shadow by a predetermined coefficient, and the length 
of the short axis of the elliptical marker 702 may use 
the value obtained by multiplying an effective short 

15 diameter (the value obtained by dividing the area of 

the shadow by the maximum long diameter of the shadow) 
of the focus candidate shadow by a predetermined 
coefficient. Fig. 70b is a view showing one example of 
the case where an elliptical marker is displayed as an 

20 aggregation of elliptical arcs 704 and 705, similar to 
the case where a marker is shown as an aggregation of 
circular arcs, as shown in Fig. 36b. In this 
modification, in the case where the ellipses 704 and 
705, respectively centered at focus candidate shadows 

25 p4 and p5, overlap each other, the overlapping portion 
of the elliptical arcs is deleted to draw the marker^as 
an aggregation of the plurality of elliptical arcs 704 
and 705, as shown in Fig. 70b. If the focus candidate 
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shadow is only displayed by being enclosed with the 
marker 711, as shown in Fig. 71a, there is a case where 
the location of the focus candidate shadow is difficult 
to identify. For this reason, as shown in Fig. 71b, in 
5 this embodiment, the contrast of the CT image in the 
area enclosed with the marker 711 is emphasized or the 
CT image is subjected to gamma processing, so that the 
focus candidate shadow can be displayed in a far more 
clearly emphasized state. 
10 Fig. 72 is a view showing a modification in 

which a CT image having an extracted focus candidate 
shadow and a CT image having no extracted focus 
candidate shadow are sequentially displayed as a 
kinematic image. In the above description of the 
15 embodiment, reference has been made to the case where a 
CT image having an extracted focus candidate shadow is 
displayed in various display modes. However, in this 
embodiment, modification is applied to the manner of 
display, here displaying in a kinematic image, which 
20 sequentially displays a CT image at a rate of 

approximately 5 to 14 images/second in the order of 
photography irrespective of the presence or absence of 
an extracted focus candidate shadow. Details of this 
kinematic image display method will be described below 
25 with reference to the flowchart of Fig. 72. 

[Step S721] The CPU 40 displays the first CT 

image . 

[Step S722] The CPU 40 determines whether an 
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abnormal portion, i.e., a focus candidate shadow, 
exists in the CT image which is presently displayed. 
If the decision result is yes, the CPU 40 proceeds to 
Step S723, whereas, if the decision result is no, the 
5 CPU 40 proceeds to Step S724. 

[Step S723] Since it has been determined 
that the abnormal portion (focus candidate shadow) 
exists in the image which is presently displayed, the 
CPU 40 increases the delay time. The delay time is the 

10 time required to display one image during kinematic 
image display. As the delay time increases, the 
display time of the image in which the abnormal portion 
(focus candidate shadow) exists becomes longer than the 
standard display time. Accordingly, the doctor can 

15 intensively observe with ample time the image in which 
the abnormal portion (focus candidate shadow) exists. 
Incidentally, in the case where a plurality of abnormal 
portions (focus candidate shadows) exist in one CT 
image, the value of the delay time may be determined 

20 according to the number of abnormal portions (focus 
candidate shadows) . 

[Step S724] Since it has been established 
that an abnormal portion (focus candidate shadow) does 
not exist in the image which is presently being 

25 displayed, the CPU 40 decreases the delay time. As the 
delay time is decreased, the display of the image comes 
to an end earlier than the normal image display. 
Incidentally, the image may also be displayed with a 
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standard delay time without decreasing the delay time. 
The value of the delay time in each of Step S723 and 
Step S724 can be arbitrarily set. 

[Step S725] Since the CT image has been 
5 displayed for a period of time equivalent to the delay 
time, the CPU 40 starts displaying the next image. 

[Step S726] The CPU 40 determines whether 
the image displayed in Step S725 is the last image. If 
the decision result is yes (the image is the last one) , 

10 the CPU 40 brings the processing to an end; whereas, if 
the decision result is no (the image not the last one) , 
the CPU 40 returns to Step S722 and repeats the above- 
described processing until the last image is displayed. 
In the above description, reference has been made to 

15 the case where an image in which no focus candidate 
shadow exists is displayed for only a short time. 
However, such an image may also be displayed for a 
longer time than the standard display time, so that the 
doctor can confirm whether a focus candidate shadow 

20 really does not exist. 

Fig. 73 is a view showing one example of 
display processing for the case where a diagnosis 
result provided by the image diagnosis supporting 
device according to this invention is displayed. In 

25 the case where a diagnosis is to be made on the basis 

of a medical image photographed with a CT device or the 
like, two doctors independently perform shadow 
detection as to the medical image in parallel with each 
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other, and subsequently meet to examine the results of 
their shadow detections. Both doctors finally make an 
integrated decision as to whether the image is 
abnormal. If the result of this integrated decision is 
that the image is abnormal, the patient undergoes a 
thorough medical examination. On the other hand, if 
the result of the integrated decision is that the image 
is not abnormal, the doctor makes a check as to their 
diagnosis result or the like by using an image 
diagnosis supporting device. Namely, the image 
diagnosis supporting device must assist in the 
diagnosis of the doctors and detect the presence or 
absence of an abnormality in a medical image which has 
undergone shadow detection by the doctors. 
Accordingly, in this embodiment, display processing 
which does not display a marker after the shadow 
detection by the doctor has been completed is adopted. 
Details of this display processing will be described 
below with reference to the flowchart of Fig. 73. 

[Step S731] The CPU 40 directly displays an 
original CT image in which a marker is not displayed. 

[Step S732] The CPU 40 records "completion 
of displaying" as to the CT image whose displaying in 
Step S731 has been completed. For example, a flag 
indicative of "completion of displaying" is added to 
the field "other information", as shown in Fig. 68. 

[Step S733] The CPU 40 makes a decision as 
to whether a display complete icon on the picture has 
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been click-manipulated by a mouse. If the decision 
result is yes (the icon is manipulated) , the CPU 40 
brings the display processing to an end, whereas, if 
the decision result is no (the icon is not 
5 manipulated), the CPU 40 proceeds to Step S734. 

[Step S734] The CPU 40 determines whether an 
icon for displaying a marker (a marker display icon) 
has been click-manipulated by the mouse. If the 
decision result is yes (the icon is manipulated) , the 
10 CPU 40 proceeds to Step S735; whereas, if the decision 
result is no (the icon is manipulated) , the CPU 40 
returns to Step S733 and repeats the processing until 
the display complete icon or the marker display icon is 
manipulated. 

15 [Step S735] The CPU 40 determines whether 

all CT images have been displayed by the processing of 
Step S731 and "completion of displaying" has been 
recorded by the processing of Step S732. If the 
decision result is yes, the CPU 40 proceeds to Step 

20 S737, whereas, if the decision result is no, the CPU 40 
proceeds to Step S736. 

[Step S736] Since it has been determined in 
the processing of Step S735 that all CT images have 
been displayed, the CPU 40 sequentially displays images 

25 to which markers are added. During the display of the 
images to which markers are added, the CPU 40 may 
display only marker-added CT images, each having an 
extracted focus candidate shadow, in a predetermined 



order, or it may sequentially display marker-added CT 
images and CT images to which no markers are added. 

[Step S737] Since it has been in the 
processing of Step S735 that all CT images have not 
5 been displayed, the CPU 40 displays a notice indicating 
that "there is an image which has not yet undergone 
shadow detection by the doctor", and informs the 
operator (doctor) that a marker-added CT image is not 
displayed, and returns to Step S731. In this manner, 
10 shadow detection by the doctor is performed on a CT 

image which has not yet undergone shadow detection. In 
addition, when shadow detection by the doctor has been 
performed on a CT image, a marker-added CT image is 
displayed . 

15 Figs. 74a to 74c show another example of 

display processing for the case where a diagnosis 
result provided by the image diagnosis supporting 
device according to this invention is displayed. In 
the description of Fig. 73, reference has been made to 

20 the case where the presence or absence of a focus 

candidate shadow is detected in a medical image which 
has been undergone shadow detection by the doctor and a 
focus candidate shadow is displayed with a marker added 
thereto. In the following description, reference has 

25 been made to a display method for the case where a 

marker is removed from a marker-added CT image. Fig. 
74a is a view showing one example of a display picture 
of a marker-added CT image. In Fig. 74a, a non-mark 



icon for selecting the marker-hidden mode, a next- 
picture icon for displaying the next picture and an end 
icon for bringing display to an end are displayed on 
the left-hand side of the picture. As shown in Fig. 
5 74b, when the non-mark icon is click-manipulated by a 
mouse, a marker which has been displayed up to this 
time disappears and is brought to a hidden state, and 
the characters "NON-MARK MODE IS ACTIVE", indicative of 
the hidden state are displayed on the bottom side of 

10 the display. Furthermore, in this embodiment, when the 
non-mark mode of Fig. 74b passes a predetermined time, 
the picture is restored to the original marker-added CT 
image, as shown in Fig. 74c. This predetermined time 
can be set in advance as a parameter. Incidentally, a 

15 mark display icon may be provided on the upper side of 
the non-mark icon so that the operator can arbitrarily 
switch the non-mark mode and a mark mode. As shown in 
Figs. 71a and 71b, an icon for switching the emphasized 
display and the non-emphasized display of a focus 

20 candidate shadow may be provided. 

In the abnormal candidate shadow detection 
processing of Fig. 9, reference has been made to the 
case where processing is performed in parallel in 
functional terms, but in sequence in temporal terms 

25 according to the kind of shadow, such as a small 

shadow, a large shadow, a ground glass opacity and a 
high-density shadow; however, each processing may also 
be executed in parallel by using time division 
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processing or a plurality of computers. 

Fig. 75 is a view showing a modification of 
the main flowchart of the abnormal candidate shadow 
detection processing of Fig. 9. The abnormal candidate 
5 shadow detection processing of Fig. 75 executes each 
kind of processing according to the kind of shadow in 
parallel. The ground glass opacity of Step S751 
corresponds to the ground glass opacity processing of 
Fig. 9. The solid type shadow processing of Step S752 

10 corresponds to three kinds of processing shown in Fig. 
9, i.e., the small shadow detection processing, the 
large shadow detection processing and the high-density 
shadow detection processing. The lung-wall-bound type 
shadow processing of Step S753 corresponds to the 

15 decision making subroutines shown in Figs. 25, 26a to 

26d and 44a to 44c. The specula type shadow processing 
of Step S754 corresponds to the processing shown in 
Figs. 63a, 63b and 64a, 64b. The blood-vessel-bound 
type shadow detection processing of Step S755 

20 corresponds to the processing shown in Figs. 50 to 53. 
The combining processing of Step S756 combines the 
results extracted by the processing of Steps S751 to 
S755. These extracted results include the coordinate 
position, the area, the maximum length and the minimum 

25 length of a shadow, as shown in Fig. 68. Accordingly, 
in the display-storage processing of Step SI 51 , a 
marker-added CT image, such as the above-described one, 
is displayed on the basis of the extracted result, and 
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the extracted result is stored in a memory or a 
magnetic disk. 

Figs. 76a to 76d, 77a and 77b are views 
showing a sixth modification of the decision making 
5 subroutine. The decision making subroutine shown Figs. 
76a to 76d, 77a and 77b is performed in place of the 
decision making subroutine El of Fig. 27, the decision 
making subroutine Fl of Fig. 29 and each of the above- 
described decision making subroutines, or it is 

10 performed in parallel with these decision making 

subroutines. This decision making subroutine uses 
variance or standard deviation in 'its abnormal 
candidate shadow detection processing. Figs. 76a to 
76d show the principle of a method of using a variance 

15 or standard deviation in abnormal candidate shadow 

detection processing. Figs. 77a and 77b illustrate one 
example of how to extract a shadow which seems not to 
be a focus . 

It is known that the possibility that a focus 
20 candidate shadow close to a circle is a cancer shadow 

(abnormal shadow) is high, whereas the possibility that 
a focus close to a rectangle is a blood vessel shadow 
(normal shadow) is high. Accordingly, a decision is 
made by using statistical processing according to the 
25 shape of a focus candidate shadow. In this statistical 
processing, the weighted center point of an area 
indicative of a focus candidate shadow is found, and 
the distance from the weighted center point to the edge 



of the area is found along the entire periphery of the 
area. A variance or standard deviation of the found 
distance is computed; and, on the basis of the variance 
or standard deviation, it is determined whether the 
5 shadow is a focus candidate shadow. Namely, as shown 
in Fig. 76a, in the case where an extracted focus 
candidate shadow is an approximately circular area, 
since a distance R from the central point to the edge 
of the area is equal to a radius RO of the circle, a 

10 variance Da in this case is 0. 

As shown in Fig. 76b, in the case where an 
extracted focus candidate shadow is a square, for 
example, the weighted center point of the square area 
is set as the central point, and a circle of radius RO 

15 that is centered at the central point is drawn. At 
this time, as shown in Fig. 76b, the length of the 
radius RO is made slightly larger than the radius of a 
circle which touches the inside of the square area, and 
it is made slightly smaller then a circle which touches 

20 the outside of the square area. Namely, the length of 
the radius RO is set between the maximum value and the 
minimum value of the distance from the central point to 
the edge of the shadow. In the case of Fig. 76b as 
well, a variance Db is found in a similar manner. 

25 As shown in Fig. 76c, in the case where an 

extracted focus candidate shadow is a rectangle, a 
circle of radius RO centered at the central point of 
the rectangular area is drawn. At this time, as shown 



in Fig. 76c, the length of the radius RO is made 
slightly larger than the radius of a circle which 
touches the shorter sides of the rectangular area, and 
is made slightly smaller then a circle which touches 
the longer sides of the rectangular area. Namely, in 
the case of the above-described square area, the length 
of the radius RO is set between the maximum value and 
the minimum value of the distance from the central 
point to the edge of the shadow. In the case of Fig. 
76c as well, a variance Dc is found in a similar 
manner . 

The relationship between the variances Db and 
Dc in the case of each of Figs. 76b and 76c is Db > Dc . 
Fig. 76d is a view showing a specific example of the 
case where the above-described principle is applied to 
an actual blood vessel shadow. A variance D is defined 
as D = (r - R0) 2 )/N. In this formula, R is the 
distance from the central point of the focus candidate 
shadow to the edge of the shadow area. RO is the 
length of the radius of the circle centered at the 
central point, and corresponds to the average value of 
a set operation. N is the total number of pixels of 
the focus candidate shadow. 2 indicates the summation 
of the distances to the edge of the focus candidate 
shadow along the entire periphery of the area. 

Figs. 77a and 77b show a modification of the 
case of finding a variance or standard deviation. In 
Figs. 77a and 77b, variance DX in the distances LX from 



one edge to the other edge of a focus candidate shadow 
along horizontal lines drawn thereon, and then a 
variance DY in the distances LY from one edge to the 
other edge of the focus candidate shadow along vertical 
lines drawn thereon, are found. Then, on the basis of 
the relationship in magnitude between each of the 
variances DX and DY and a predetermined value 
indicative of the shape of the shadow, a decision is 
made as to whether the shadow is a cancer shadow, as 
shown in Fig. 77a, or a blood vessel shadow, as shown 
in Fig. 77b. Incidentally, although the variances may 
be directly used, it goes without saying that the 
decision can be made by using a standard deviation 
which is the square root of each of the variances. A 
method of extracting the edge of a focus candidate 
shadow may use any of a method using threshold 
processing or the like for shadows, a method using 
particular density contours for shaded shadows, and 
Laplacian processing (refer to MEDICAL IMAGING 
TECHNOLOGY VOL 16, No. 3, May 1998, pp. 209-219), and, 
further, these methods may also be arbitrarily 
combined . 

Fig. 78 is a view showing a modification of 
display processing for the case where a diagnosis 
result provided by the image diagnosis supporting 
device according to this invention is displayed. Figs. 
79a to 79c show one example of a display picture 
accompanying the display processing of Fig. 78. As 



described previously in connection with Fig. 73, in the 
case where a doctor is to make a diagnosis on the basis 
of a medical image photographed with a CT device or the 
like, if a decision result found by a computer is 
5 presented to the doctor before a diagnosis, the 
diagnosis has the risk of being influenced by 
preoccupations. Accordingly, it is desirable that the 
computer program of this invention not be executed 
before the diagnosis of the doctor. Details of this 

10 display processing will be described below with 
reference to the flowchart of Fig. 78. 

[Step S781] The CPU 40 determines whether an 
activating button for activating an execution 
processing program for an image diagnosis supporting 

15 , device according to this embodiment has been click- 
manipulated by a mouse. If the decision result is yes 
(the activating button is activated) , the CPU 40 
proceeds to Step S783; whereas, if the decision result 
is no, the CPU 40 repeats the processing of this step 

20 until the activating button is manipulated. 

[Step S782] The CPU 40 determines whether 
there exits a record whose image has been displayed on 
the CRT display 48 (a flag indicative of the completion 
of displaying) , and, if the decision result is yes 

25 (such record exists), the CPU 40 proceeds to Step S784; 
whereas, if the decision result is no (such record 
exists), the CPU 40 proceeds to Step S783. This is 
because the record whose image has been displayed on 
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the CRT display 48 is regarded as diagnosed by the 
doctor. For a far more exact diagnosis, reference may 
be made to records of shadow detection by the doctor, 
and the decision may be made on the basis of the 
records. In this case, if the CPU 40 determines that 
there is a record of shadow detection (yes), the CPU 40 
proceeds to Step S784; whereas, if the CPU 40 
determines that there is not a record of shadow 
detection (no), the CPU 40 proceeds to Step S783. 

[Step S783] Since an image which has not yet 
been diagnosed by the doctor is to be displayed, the 
CPU 40 displays an error message, and returns to Step 
S781. As this error message, an error message, as 
shown in Fig. 7 9a or 7 9b may be displayed. In Fig. 
79a, an error message indicating that "error: the 
program can be activated only after shadow detection by 
the doctor" is displayed on the bottom side of a 
tomographic image. In Fig. 79b, an error message 
indicating that "note: the program can be activated 
only when there is a diagnosis record" is displayed on 
the bottom side of the tomographic image. 

[Step S784] The CPU 40 activates an 
execution processing program. 

[Step S785] The CPU 40 finds a focus 
candidate shadow through a computation on the basis of 
the execution processing program, and displays the 
result. The CPU 40 records the displayed information 
on a magnetic disk or the like as required. As shown 



in Fig. 79c, the display of the computation result 
shows the fact that, for example, the first tomographic 
image has one abnormal portion enclosed with a circle, 
and a value indicating how many abnormal portions have 
5 been found in total inclusive of those in other 

tomographic images. Fig. 7 9c shows that there are 
three abnormal portions in total. 

Figs. 80a to 82 are views showing a seventh 
modification of the decision making subroutine. The 

10 decision making subroutine of Figs. 80a to 82 is 

performed in place of the decision making subroutine El 
of Fig. 27, the decision making subroutine Fl of Fig. 
29 and each of the above-described decision making 
subroutines, or it is performed in parallel with these 

15 decision making subroutines. This decision making 

subroutine uses the area of a shadow and the ratio of 
areas associated with this shadow, in abnormal 
candidate shadow detection processing. Figs. 80a to 
80c show one example of the case of finding the area 

20 ratio of the total area of the entire focus candidate 
shadow to the area of a concave portion formed in the 
edge portion of the shadow. Figs. 81a and 81b show one 
example of the process of how a bifurcating portion of 
a blood vessel shadow is extracted. Fig. 82 is a 

25 flowchart showing one example of procedures for the 
case of finding the area ratio of Figs. "80a to 80c. 
Fig. 83 is a view showing one example of a display 
which accompanies the processing of Figs. 80a to 80c. 
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An extracted region, as shown in Fig. 81b, is 
obtained by discriminating between the high and low 
luminances of a CT image as shown in Fig. 81a. To 
identify this extracted region as a blood vessel 
5 shadow, this extracted region is binarized by threshold 
processing. By this binarizing processing, a binarized 
blood vessel region as shown in Fig. 80a is extracted. 
Fig. 80b shows the case where a shadow of a cancer or 
the like is binarized. When the shadow of the cancer 

10 or the like shown in Fig. 80b is compared with the 

shadow or the like of the blood vessel region shown in 
Fig. 80a, the difference therebetween can be readily 
understood, and it can be understood that the shadow of 
the cancer or the like has a shape close to that of a 

15 circle. In the case of the blood vessel shadow shown 
in Fig. 80a, an area ratio SR of the sum of areas sla, 
sib and sic of the respective concave portions of the 
shadow to a total area s2 of the shadow is used to make 
a decision as to a focus candidate shadow. The area 

20 ratio SR may be found by the following ratio formula 

which simply shows the ratio of the area si to the area 
s2: SR = sl/s2, or it may also be found by the 
following ratio formula, which shows the ratio of the 
total of the area si and the area s2 to the area s2 : SR 

25 = s2/(sl + s2) . In the case of the shadow of the 

cancer or the like shown in Fig. 80b, an area ratio SR 
= sl0/s20 of an area 10s of the concave portion of the 
shadow to a total area s20 of the shadow is used to 
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make a decision as to a focus candidate shadow. Fig. 
80c shows a method of finding the area of the concave 
portions. Details of the processing of finding the 
areas of the concave portions will be described below 
5 with reference to the flowchart of Fig. 82. 

[Step S821] As shown in Fig. 80c, the CPU 40 
selects a pair of points pi and p2 on the contour of 
the shadow, and connects both points pi and p2 by a 
straight line. The pair is selected only at the first 

10 time in this processing. 

[Step S822] The CPU 40 places a point p 
which moves by a constant length at one time from the 
point pi toward the point p2 , on the straight line 
which connects the two points pi and p2 . Each time the 

15 point p moves by the constant length, the CPU 40 

determines whether the point p exists on an extracted 
region (s2) . If the decision result is yes (the p 
exists on the extracted region s2) , the CPU 40 proceeds 
to Step S824, whereas, if the decision result is no, 

20 the CPU 40 proceeds to Step S823. 

[Step S823] Since the point p does not exist 
on the extracted region (s2) , the CPU 40 records a 
particular value (for example, "5") on that portion. 

[Step S824] The CPU 40 determines whether 

25 the point p has completely moved on the straight line 
which connects the points pi and p2, and if the 
decision result is no (the movement of the point p has 
not yet been completed) , the CPU 40 returns to Step 
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S822; whereas, if the decision result is yes (the 
movement of the point p has been completed) , the CPU 40 
proceeds to Step S825. By the processing of Step S822 
to Step S824, while the point p is moving from the 
5 point pi to the point p2, the particular value (for 
example, "5") is recorded in a region, except for the 
extracted region (s2) . 

[Step S825] In the case where the CPU 40 
sets the point pi as a fixed point and the point p2 as 

10 a moving point, the CPU 40 determines whether the 

moving point p2 has moved on the entire contour of the 
extracted region. In the case where the CPU 40 sets 
the point p2 as a fixed point and the point pi as a 
moving point, the CPU 40 determines whether the moving 

15 point pi has moved on the entire contour of the 

extracted region. If the decision result is no (the 
movement of the moving point has not yet been 
completed) , the CPU 40 returns to Step S821 and 
performs similar processing on the next two points. If 

20 the decision result is yes, the CPU 40 proceeds to Step 
S826. 

[Step S826] The CPU 40 finds the area (si) 
of the extracted region in which the particular value 
(for example, "5") is recorded. This area si is the 
25 area of the concave portions. 

The CPU 40 finds an area ratio RS of the area 
si to the area s2 of the extracted region. 

[Step S828] The CPU 40 determines whether 
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the area ratio RS is larger than a preset constant 
value. If the decision result is yes (larger), the CPU 
40 proceeds to Step S829, whereas, if the decision 
result is no (smaller or equal), the CPU 40 proceeds to 
5 Step S82A. 

[Step S829] Since it has been determined in 
Step S828 that the area ratio RS is larger than the 
constant value, the possibility that the extracted 
shadow is a blood vessel shadow is high. Accordingly, 
10 the CPU 40 deletes the shadow from focus candidate 
shadows . 

[Step S82A] Since it has been determined in 
Step S828 that the area ratio RS is not larger than the 
constant value, the possibility that the extracted 

15 shadow is a focus candidate shadow is high. 

Accordingly, the CPU 40 selects the shadow as a focus 
candidate shadow and saves information, such as the 
coordinate position thereof. 

It is preferable to identif iably display the 

20 nature of a focus candidate shadow, such as a positive 
indication that the focus candidate shadow is a focus, 
a nature close to a positive indication (apparent- 
positive) or a negative indicating that the focus 
candidate shadow is not a focus, because the display of 

25 the nature supports shadow inspection by a doctor. 
Accordingly, in the following embodiment, reference 
will be made to an image diagnosis supporting device 
that is capable of readily, instantaneously and 



identifiably displaying the nature of a shadow, which 
seems to be an extracted focus candidate. 

Fig. 83 is a view showing one example of the 
case where information for identifying the nature of a 
5 focus candidate shadow on the basis of the area ratio 
RS, such as a positive indicating that the focus 
candidate shadow can be determined as a focus, a nature 
close to a positive (apparent-positive) and a negative 
indicating that the focus candidate shadow is not a 

10 focus, is displayed as image supplementary information. 
In the display of Fig. 83, the left-hand window 
displays a graph in which the horizontal axis indicates 
a CT image having a shadow which is to be judged 
according to the area ratio RS, and the vertical axis 

15 corresponds to the area ratio RS . The right-hand 
window displays the CT image which is the decision 
target. In the graph, white dots (O) denote the result 
of a computation on the extracted shadow, and they are 
displayed at positions corresponding to the magnitude 

20 of the area ratio RS . Initially, all marks are 

displayed as white dots (O) and whether the shadow is 
positive is in an undetermined state. When a triangle 
(A) on the bottom side of the graph is moved by a 
mouse, an arbitrary white dot (O) can be selected on 

25 the graph. The white dot (O) selected by the triangle 
(A) changes to a black dot (•) . At the same time, a CT 
image corresponding to the selected black dot ( ) is 
displayed on the right-hand window. Accordingly, the 
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operator (doctor) who observes this CT image determines 
whether the shadow is positive or negative, and if the 
operator (doctor) determines that the shadow is 
negative, the operator (doctor) clicks a "false" icon 
5 on the bottom of the CT image with the mouse. In this 
manner, the black dot (•) changes to a square (□) . On 
the other hand, if the operator (doctor) determines 
that the shadow is positive, the operator (doctor) 
clicks a "positive" icon with the mouse. In this 

10 manner, the black dot (•) changes to an X mark. At 
this time, the highest one of the area ratios RS 
indicated by X marks becomes a decision threshold 
value. On the basis of this decision threshold value, 
a threshold value is determined. The threshold value 

15 is a value obtained by multiplying the decision 

threshold value by a constant (for example, 1.1). 
Namely, the threshold = the decision threshold value x 
the constant. Incidentally, the constant may be found 
by finding the distribution of squares (□) and using a 

20 standard deviation thereof. Incidentally, in the case 
where the threshold value is determined, a decision as 
to white dots (O) is made on the basis of this 
threshold value. In this case, squares (□) or X marks 
to which white dots (O) have changed on the basis of 

25 the decision with the threshold value may be displayed 
in different colors or by dotted lines so that the 
operator (doctor) can recognize that a decision as to 
the white dots (O) has been made on the basis of the 



threshold value. In this embodiment, the display as 
shown in Fig. 83 may also be displayed as an image that 
is impossible to identify or a focus candidate image as 
shown in Fig. 33. In this case, the white dots (O) 
indicative of the undetermined state may be displayed 
as image supplementary information on the side of the 
decision-impossible image, and the X marks determined 
as positive may be displayed as image supplementary 
information on the side of the candidate image. 

Figs. 84a, 84b, 85a and 85b show a 
modification of the method of finding the area ratio. 
First, as shown in Fig. 84a, a circle is generated 
which is inscribed in the contour of a shadow at three 
points, and the area ratio RS of the total of areas si 
to s3 of individual regions into which the shadow is 
divided by the circle to an area slO of the circle is 
found. This area ratio RS is calculated on the basis 
of RS = (si + s2 + s3)/sl0. Then, a circle is 
generated which is circumscribed outside the shadow at 
three points, and the area ratio RS of the area sO of 
the circle to the area s2 of the shadow is found. This 
area ratio RS is calculated on the basis of RS = 
s2/sl0 . 

In Fig. 85a, a polygon (in Fig. 85a, a 
triangle) is generated which is inscribed in the 
adjacent lines of a blood vessel shadow, and the area 
ratio RS of the total of areas tl to t3 of individual 
regions into which the shadow is divided by the polygon 



to an area tO of the polygon is found. This area ratio 
RS is calculated by the formula RS = (tl + t2 + t3)/t0. 
In Fig. 85b, a polygon (in Fig. 85b, a pentagon) which 
is inscribed in focus candidate shadow is generated, 
5 and the area ratio RS of the total of areas tl to t5 of 
individual regions into which the shadow is divided by 
the polygon to an area TO of the polygon is found. 
This area ratio RS is calculated by the formula RS = 
(tl + t2 + t3 + t4 + t5)/T0. To find the area ratio, 

10 in addition to the above-described areas tO to t3 and 
TO to T5, the areas sla, sib, sic and alO of the 
respective concave portions formed outside the shadows 
may be arbitrarily used. 

Furthermore, the concave portions have 

15 another feature. Namely, when a concave portion of a 

bifurcation of a blood vessel is found, there is a case 
where three separate regions are obtained. By using 
this fact, it is possible to delete a blood vessel 
bifurcation . 

20 In the description of this embodiment, 

reference has been made to the case where the contour 
edge of a binary image is used. However, since the 
contour edge of a binary image corresponds to the 
isosbestic line of a multi-valued image shadow, it is 

25 possible to perform similar processing on the 

isosbestic line without binarization . Although the 
magnitude of this key feature quantity may be directly 
used in a decision, the key feature quantity may be 
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provided as an input signal to a neural network 
together with other key feature quantities, and the 
output signal from this neural network may also be used 
in decision making means for selecting a suitable 
5 method from among a method using a variance and a 

method using an area ratio, according to the area of a 
sample to which the method is to be applied; for 
example, a selecting menu or the like may be selected 
with a mouse to improve the manipulability of doctor's 

10 diagnosis supporting software. 

In addition, by combining a method using a 
variance and a method using an area ratio, it is 
possible to discriminate between a cancer shadow and a 
blood vessel shadow with far higher accuracy, whereby 

15 it is possible to improve the reliability of the 

diagnosis supporting software. In addition, in the 
extraction of a shadow/ in the case where a special 
shadow, including a shadow of a pleural membrane, is to 
be found, processing which allows for specialty is 

20 needed, as shown in Figs. 86a to. 86c. Figs. 86a to 86c 
show one example of the case where a special shadow, 
including a shadow of a pleural membrane, is found. In 
a CT image as shown in Fig. 8 6, there exist a shadow 
861 due to inflammation or the like, a shadow 552 of a 

25 blood vessel or the like and a shadow 553 perpendicular 
to the pleural membrane. The CT image shown in Fig. 
86a is binarized into an image as shown in Fig. 86b. 
Furthermore, as shown in Fig. 8 6c, when only a contour 
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865 of the pleural membrane is taken out and the 
relationship between the shadows 861 to 863 and the 
contour 865 of the pleural membrane is viewed, the 
normal blood vessel shadow 861 is deleted on condition 
5 that it is not in contact with the contour 865 of the 
pleural membrane. Furthermore, it is possible to 
discriminate between the wide shadow 862 due to 
inflammation and the shadow 863, which isln 
perpendicular contact with the contour 865 of the 

10 pleural membrane, because the wide shadow 862 and the 
shadow 863 differ in the length of contact with the 
contour 8 65 of the pleural membrane. By designating a 
particular range of threshold values for the CT image 
and emphasizing the image, it is possible to extract 

15 the contour 865, as shown in Fig. 86c. After the 

contour 8 65 has been extracted, the extracted contour 
865 is cut and isolated to identify each of the blood 
vessel shadows 861 to 863 on the basis of the state of 
connection of the contour 865 of the pleural membrane 

20 with each of the blood vessel shadows 861 to 863. In 
this manner, it is possible to identify the kinds of 
shadows from the relationship between each of the 
shadows and the contour of the pleural membrane. 

In the case where the above-described various 

25 feature quantities are used to make a decision as to 
whether a shadow is a focus candidate, even if 
processing, such as statistical processing or neural 
networks, are adopted in an intermediate step, there is 
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a case where it is finally necessary to determine 
accurate parameters for thresholding processing or the 
like. In this case, it goes without saying that it is 
common practice to adopt so-called "learning" in which 
5 parameters are made more accurate through operations in 
an inverse direction from normal processing, from 
images obtained every day. 

In addition, according to this invention, it 
is possible to provide novel feature quantities for 

10 identifying focus shadows and processing procedures 
using such feature quantities. 

As described above, according to the image 
diagnosis supporting device of this invention, the 
above-described various kinds of shadows can be handled 

15 in an integrated manner, and so it becomes easy to 
adjust parameters for improving the discrimination 
capability, and it also becomes easy to create computer 
programs . 

In addition, since a focus candidate shadow 
20 can be selected from shadows by simple processing, the 
computation time of a computer can be reduced, whereby 
an accurate focus candidate can be rapidly extracted 
and an extracted focus candidate can be instantaneously 
displayed for a doctor. Accordingly, the image 
25 diagnosis supporting device is useful in the early 

finding of cancers or the like or the inspection of the 
effect of treatment. 

In another embodiment of the present 



invention, the CT image is displayed such that a 
certain point of contemplation is fixed at a certain 
position in almost the center of a marker. That is, 
the CT image itself is shifted in parallel vertically 
5 and laterally so that the point of contemplation 

(almost center of the marker) is positioned in almost 
the center of a CRT display 48. Furthermore, the 
position of the point of contemplation can be freely 
set by an operator such that a widest vacant area is 
10 found on the screen, and the center thereof is set to 
the position of the point of contemplation. Also, the 
position of the point of contemplation may be matched 
with the height of eyes of an operator. 

Fig. 87 is a view showing one example of CT 
15 images of image numbers ' 1 to N corresponding to results 
of abnormal candidate shadow extraction processing 
performed by the above diagnosis supporting system. As 
apparent from the figure, an abnormal candidate shadow 
at one location is extracted for the CT images of image 
2 0 numbers 1 and N, and abnormal candidate shadows at two 
locations are extracted for the CT image of image 
number 2. Fig. 8 8 is a view showing one example of a 
display processing flow performed by a medical image 
displaying apparatus. A CPU 40 operates in accordance 
25 with the display processing flow. Figs 89a to 89c are 
views showing one example of a display screen on the 
CRT display showing how the CT image of Fig. 87 is 
displayed by this display processing flow. As apparent 
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from the figure, each CT image of Fig. 87 is shifted in 
parallel vertically and laterally so that a point of 
contemplation (almost center of marker) is positioned 
in almost the center of the' CRT display 48. Details of 
5 this display processing flow will be described below on 
a step-by-step basis. If an icon for operation is 
displayed on the screen of the CRT display 48, the 
point of contemplation is set in almost the center of 
an effective display area capable of displaying a 

10 medical image. 

[Step S180] The CPU 40 designates position 
information of the point of contemplation (X0, Y0) as a 
display address in the screen or a two-dimensional 
array memory buffer storing images. This designation 

15 is done by default/key input/mouse designation or the 
like . 

[Step S181] The CPU 40 reads coordinate 
information indicating a first abnormal candidate 
shadow area, for example barycentric coordinates of the 

20 shadow from a main memory 42/magnetic disk 44, and sets 
the coordinate information to (X, Y) . Fig. 90 is a 
view showing a concept of abnormal candidate shadow 
detection processing information recorded in the 
magnetic disk 44, and the record states of images of 

25 numbers Nl to Nm determined to be abnormal by a doctor. 
As apparent from the figure, the abnormal candidate 
shadow detection processing information is comprised of 
image numbers, coordinate information (X: X coordinate, 
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Y: Y coordinate) indicating an abnormal candidate 
shadow area, and the pixel number thereof. In 
addition, the image numbers Nl to Nm are selected and 
recorded by processing described later. 
5 [Step S182] The CPU 40 reads an image 

corresponding to a read image number from the main 
memory 42/magnetic disk 44. 

[Step S183] For delaying display by a 
certain amount of time, the CPU 40 sleeps (delays) . 

10 Furthermore, sleep time may be set to "0" solely for 
first image display. 

[Step S184] The CPU 40 shifts the image in 
parallel vertically and laterally so that coordinate 
information (X, Y) of an image number to be displayed 

15 matches the coordinate (X0, Y0) of the point of 
contemplation . 

[Step S185] The CPU 40 superimposes on a CT 
image a circular marker with the coordinate (X0, Y0) of 
the point of contemplation at the center. Furthermore, 

20 an arrow pointed at the point of contemplation may be 
used instead of the circular marker. Furthermore, in 
Figs. 89a to 89c, an image number is displayed on the 
right side of the marker in addition to the CT image. 
Consequently, the display position of the marker is 

25 fixed in almost the center of the screen, and the CT 

image is shifted in parallel vertically and laterally, 
and therefore the doctor can intensively stare a marker 
portion, and a need to follow the marker is eliminated, 



thus alleviating the degree of fatigue when shadow- 
checking is carried out. Furthermore, it is also 
possible to freely change the display position of the 
marker to a position other than the center of the 
5 screen according to instructions from the doctor. 

[Step S186] If the doctor shadow-checking 
the image determines that an abnormal candidate shadow 
thereof is abnormal, the number of the image is 
recorded in the main memory 42/magnetic disk 44 or the 

10 like by making an indication by key input, mouse click 
or the like. Here, the number of the image of which 
the abnormal candidate shadow has been determined to be 
abnormal is recorded in the magnetic disk 44 as its 
image number Nl to Nm as shown in Fig. 90. 

15 [Step S187] The CPU 40 reads coordinate 

information indicating a next abnormal candidate shadow 
area and the image number thereof from the main memory 
42/magnetic disk 44, and sets the coordinate 
information to (X, Y) . 

20 [Step S188] The CPU 40 determines whether 

processing is ended, and processing returns to step 
S182 if the processing is not ended, and processing 
proceeds to a return if the processing is ended. 

As another embodiment of the present 

25 invention, the case will now be described where display 
is provided such that the point of contemplation 
(almost center of marker) is positioned at two points 
in almost the center of the CRT display 48. Figs. 91a 
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to 91c are views showing one example in which the CT 
image of Fig. 87 is shifted in parallel vertically and 
laterally so that the point of contemplation, i.e. the 
marker is positioned at two points in almost the center 
5 of the screen. Here, the coordinates of the two points 
are positioned near the barycenter of a left image and 
the barycenter of a right image when a sectional image 
display area 1001 of a test object is laterally divided 
at the center. Consequently, the distance in which the 

10 CT image is laterally shifted as a whole is reduced, 

and thus the position of the marker in an overall image 
can easily be seized. If lateral shift of the CT image 
is small as shown in Figs. 91a to 91c, where the marker 
is positioned in the overall image can easily be 

15 seized. In this case, at step S180 in display 

processing of Fig. 98, two areas: a position (XOL, YOL) 
that is slightly left from near the center and a 
position (XOR, YOR) that is slightly right from near 
the center as points of contemplation are designated as 

20 display addresses. At step S181, whether the 

coordinates (X, Y) of the abnormal shadow area exist in 
the left or right of the sectional image display area 
1001 is determined when the coordinates are read. At 
step S184, the image is shifted in parallel so that the 

25 coordinates (X, Y) of the abnormal shadow area match 

the coordinates (XOL, YOL) if the coordinates exist in 
the left, and the image is shifted in parallel so that 
the coordinates (X, Y) of the abnormal shadow area 



match the coordinates (XOR, YOR) if the coordinates 
exist in the right. Consequently, as shown in Figs. 
91a to 91c, the marker is positioned at two points in 
almost the center of the screen. The two points in 
5 almost the center may be positioned near the barycenter 
of an upper image and the barycenter of a lower image 
when the display area 1001 is horizontally divided into 
two parts of upper and lower areas at the center 
thereof . 

10 As another embodiment of the present 

invention, the case will be described where a marker to 
be displayed on a next CT image is preliminarily 
displayed without setting the point of contemplation 
described above. For example, as shown in Fig. 92, a 

15 marker 132 is displayed for an abnormal candidate 

shadow 131 in a CT image currently displayed, and a 
preliminary display marker 133 of dotted lines is 
displayed on a CT image to be displayed subsequently. 
Thus, at this time, the doctor can recognize that an 

20 abnormal candidate shadow will be displayed at the 

position of the preliminary display marker 133 while 
checking the abnormal candidate shadow 131 with the 
marker 132, and when the CT image is changed, he or she 
can instantly move the point of contemplation to the 

25 position of the preliminary display marker 133 to start 
shadow-checking. Fig. 93 is a view showing one example 
of processing of displaying a preliminary display 
marker performed by a medical image displaying 
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apparatus. The CPU 40 operates this display processing 
flow . 

[Step S141] The CPU 40 resets an image 
number register N to "0" 

[Step S142] The CPU 40 reads an image 
corresponding to the Nth image number recorded in the 
image number register N from the main memory 
42/magnetic disk 44, and displays the read image on the 
CRT display 48 together with a red marker. 

[Step S143] For delaying display by a 
certain amount of time, the CPU 40 sleeps (delays) . 
Furthermore, sleep time may be set to "0" solely for 
first image display. 

[Step S144] A preliminary display marker is 
displayed in advance in an area of an image to be 
subsequently displayed, namely an (N+l)th image, where 
an abnormal candidate shadow is expected to be 
displayed. In Fig. 92, the preliminary display marker 
is shown by dotted lines, but in this case, a yellow 
preliminary mark is displayed on the CRT display 48. 

[Step S145] A preliminary display marker is 
displayed in advance in an area of an image to be 
displayed further subsequently, namely an (N+2)th 
image, where an abnormal candidate shadow is expected 
to be displayed. In Fig. 92, this second preliminary 
display marker is not shown, but in this case, a blue 
preliminary mark is displayed on the CRT display 48. 

[Step S146] 1 is added to the image number 
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register N in preparation for subsequent processing. 

[Step S147] The image number register N 
determines whether the maximum value of an image 
displayed for shadow-checking is reached or not, and 
processing is ended if it is reached (yes), and 
processing proceeds to step S148 if it is not reached 
(no) . 

[Step S148] For delaying display by a 
certain amount of time, the CPU 40 sleeps (delays) to 
return the processing to step S142. 

As described above, for the abnormal 
candidate shadow 131 in a CT image displayed currently, 
the marker 132 is displayed, and also a preliminary 
display marker of an abnormal candidate shadow to be 
displayed subsequently and a preliminary display marker 
of an abnormal candidate shadow to be displayed further 
subsequently are displayed. Furthermore, if only a 
preliminary marker in a subsequent CT image is 
displayed as shown in Fig. 92, processing at step S145 
may be skipped. In addition, the color of marker is 
not limited to those described above, but may be freely 
set by the doctor. In addition, for the preliminary 
marker, not only the color of the marker but also its 
shape such as a triangle or rectangle and the like may 
be changed. 

As another embodiment of the present 
invention, display processing will be now described in 
which the doctor wants to observe abnormal candidate 



shadows after all abnormal candidate shadows are 
displayed as described above or in order of sectional 
numbers as in the conventional technique. In this 
case, displaying the abnormal candidate shadows again 
5 from the leading shadow requires much time for display, 
and is thus inefficient. Thus, in this embodiment, an 
area required to be displayed (a part, of test object) 
is indicated using a pointing device such as a mouse, 
whereby the target image is quickly displayed- Fig. 

10 94a is a view showing the case where when a part of 
test object in a CT image being displayed is clicked 
with the mouse cursor 151, CT images each having an 
abnormal candidate shadow near an arrow of a mouse 
cursor 151 are selectively displayed in order together 

15 with circular markers as shown in Fig. 94b. Fig. 95 is 
a view showing one example of abnormal candidate shadow 
retrieval and display processing performed by a medical 
image displaying apparatus in which abnormal candidate 
shadows each existing in a designated area are 

20 displayed in order. The CPU 40 operates in accordance 
with this display processing flow. 

[Step S161] As shown in Fig. 94a, the 
pointing device (position coordinate inputting device) 
such as a mouse is used to designate a predetermined 

25 position on a CT image to input coordinates. 

[Step S162] An image display unit is divided 
into a plurality of grids as shown in Fig. 96a, and 
thus which grid the coordinates inputted at the above 
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step S161 correspond to, namely a designated area of 
the coordinates is specified. 

[Step S163] Images each existing in a 
designated area with barycenter coordinates of an 
abnormal candidate shadow or pixels of an abnormal 
candidate shadow specified at the above step S162 are 
retrieved and found from abnormal candidate shadows of 
an examinee detected by a diagnosis supporting system, 
and are displayed in order with shadow portions labeled 
with markers. Furthermore, if a plurality of images 
belong to the same area, they are displayed in order 
beginning with the leftmost image on the screen. For 
this order of display, they may be displayed in order 
from the rightmost to the leftmost, from the uppermost 
to the lowermost, or from the lowermost to the 
uppermost, or in order of descending proximity to the 
mouse pointer. ■ In addition, for timing in display, 
they may be displayed in order in association with 
click of a mouse or the like, or may be displayed in 
order at predetermined time intervals. 

[Step S164] Whether display processing is 
completed or not is determined, and the processing is 
ended if it is completed, and processing returns to 
step S161 if it is not completed. 

In the embodiment described above, the 
example in which a plurality of divided grits (20 
divided grids) shown in Fig. 96a are used for 
specifying a designated area has been described, but 
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the invention is not limited thereto, and as shown in 
Fig. 96b, the inside of a circle with a predetermined 
radius centering around a coordinate position 
designated with a pointing device may be set to a 
5 designated area to retrieve an abnormal candidate 
shadow existing within the designated area. 

When a marker is displayed, the size of the 
circle of the marker may be made to be proportional to 
the degree of focus certainty or the size of a shadow 

10 to reflect focus certainty, or if the number is the 
same, the focus certainty may be used to make an 
ordinal rank. Furthermore, not only the size of the 
circle of the marker but also the size of the marker 
itself may be thickly displayed, widely displayed or 

15 flash-displayed in proportion to the focus certainty. 
Furthermore, the marker is not limited to a circular 
shape, but may be rectangular, elliptic or the like. 
Furthermore, only a focus candidate shadow may be 
displayed in color or solid. Furthermore, in the 

20 present invention, the CT image has been described as 

an example, but the present invention may be applied to 
medical images including MRI images and ultrasonic 
images as a matter of course. 

Figs. 97a and 97b are views each showing 

25 another example of the present invention, in which a 
plurality of abnormal candidate shadow images are 
displayed at a time. 

Image numbers Nl-2, Nl-1, Nl+1 are 
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numbers added to medical images in the order in which 
the abnormal candidate shadow is extracted. There are 
cases where an operator wants to display a plurality of 
abnormal candidate shadow images at a time and select 
5 therefrom abnormal candidate shadows of higher degrees 
of abnormality. In this case, an abnormal candidate 
shadow area of an image in the middle is always 
displayed at a designated position (display address) in 
a display for alleviating a degree of fatigue of the 

10 eyes of the operator. 

In Fig. 97a, consecutive three abnormal 
candidate shadow images Nl-1, Nl and N+l are displayed 
such that they are laterally arranged. In this case, 
the abnormal candidate shadow area of image number Nl 

15 is positioned in almost the center of the display. 
That is, the coordinates (X, Y) of the abnormal 
candidate shadow area of image number Nl are read, and 
the image Nl is displayed such that the coordinates 
match the coordinates (X0, Y0) of the point of 

20 contemplation as a display address set in almost the 
center of the display. Images Nl-1 and Nl+1 are 
positioned on the left and right sides of the image Nl, 
respectively. The abnormal candidate shadow area of 
each image is labeled with a marker. 

25 When the operator provides instructions to 

display a next image, the images are shifted by one 
image in the right direction, and abnormal candidate 
shadow images Nl-2, Nl-1 and Nl are laterally arranged 
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as shown in Fig. 97b. In this case, the abnormal 
candidate shadow area of image number Nl-1 is 
positioned in almost the center of the display. 

As described above, the image diagnosis 
5 supporting device of the present invention has an 

advantage that when a CT image including an abnormal 
candidate shadow is displayed, a viewer can observe the 
abnormal candidate shadow without significantly 
shifting the line of sight so that the degree of 
10 fatigue of the viewer is alleviated in some degree . 

The present invention further discloses 
various embodiments as follow. 

(1) An image diagnosis supporting device 

comprising : 

15 digitizing unit for applying predetermined 

image processing to a medical image and generating a 
multi-valued image ; 

extracting unit for executing at least one 
decision making processing routine on said multi-valued 

20 image generated by said digitizing unit and extracting 
an abnormal candidate shadow; 

display unit for displaying in said medical 
image said abnormal candidate shadow extracted by said 
extracting unit so that it is easily identifiable; 

25 unit for fixing a display position of the 

abnormal candidate shadow extracted by said extracting 
unit on a predetermined area of a display screen of 
said display unit; and 
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control-display unit for shifting a display 
position of said medical image so that said abnormal 
candidate shadow is displayed on the predetermined area 
of the display screen of said display unit, fixed by 
5 said fixing unit, and control-displaying the medical 
image including said abnormal candidate shadow. 

(2) The image diagnosis supporting device 
according to item (1), wherein said control-display 
unit comprises unit for displaying in said medical 

10 image or an area other than said medical image the 

abnormal candidate shadow extracted by said extracting 
unit each time one of said extraction processing 
routines is completed. 

(3) The image diagnosis supporting device 

15 according to item (1), wherein said control-display 

unit comprises unit for displaying a magnified image of 
an area magnified image of an area including said 
abnormal including said abnormal candidate shadow in 
said medical image or an area other than said medical 

2 0 image. 

(4) The image diagnosis supporting device 
according to item (1), wherein said control-display 
unit comprises unit for controlling an order of display 
of said abnormal candidate shadow according to its 

25 position in said medical image and displaying said 
medical image. 

(5) The image diagnosis supporting device 
according to item (4), wherein said control-display 
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unit comprises unit for controlling the order of 
display of said abnormal candidate shadow according to 
its pointing device operating position in said medical 
image and displaying said medical image having said 
5 abnormal candidate shadow near said operating position. 

(6) The image diagnosis supporting device 
according to item (1), wherein said control-display 
unit comprises unit for displaying a marker surrounding 
said abnormal candidate shadow extracted by said 

10 extracting unit. 

(7) The image diagnosis supporting device 
according to item (6), wherein said extracting unit 
comprises unit for detecting focus certainty of said 
extracted abnormal candidate shadow, and said control- 

15 display unit comprises unit for displaying said marker 
in a different display form based on said detected 
focus certainty. 

(8) The image diagnosis supporting device 
according to item (6), wherein said control-display 

20 unit comprises unit for contrast-highlighting or gamma 
processing-highlighting the area surrounded by said 
marker and clearly displaying said abnormal candidate 
shadow. 

(9) The image diagnosis supporting device 

25 according to item (1), wherein said control-display 

unit does not provide said identifiable display for a 
medical image of which reading by a doctor is not 
completed . 
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(10) An image diagnosis supporting device 

comprising: 

digitizing unit for applying predetermined 
image processing to a medical image and generating a 
5 multi-valued image; 

extracting unit for executing at least one 
decision making processing routine on said multi-valued 
image generated by said digitizing unit and extracting 
an abnormal candidate shadow; 
10 display unit for displaying in said medical 

image said abnormal candidate shadow extracted by said 
extracting unit so that it is easily identifiable; 

unit for detecting a display position of an 
abnormal candidate shadow immediately following the 
15 medical image that is currently displayed when said 
medical images are sequentially displayed on said 
display unit while changing a slice position at which 
said medical images are adjacent to each other; and 

control-display unit for control-displaying 
20 on said display unit information of the display 

position of the abnormal candidate shadow detected by 
said detection unit and said medical image that is 
currently displayed. 

(11) The image diagnosis supporting device 

25 according to item (10), wherein said control-display 

unit comprises unit for displaying a magnified image of 
an area including said abnormal candidate shadow in 
said medical image or an area other than said medical 
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image . 

(12) The image diagnosis supporting device 
according to item (10), wherein said control-display 
unit comprises unit for controlling an order of display 

5 of said abnormal candidate shadow according to its 
position in said medical image and displaying said 
medical image. 

(13) The image diagnosis supporting device 
according to item (12), wherein said control-display 

10 unit comprises unit for controlling the order of 

display of said abnormal candidate shadow according to 
its pointing device operating position in said medical 
image and displaying said medical image having said 
abnormal candidate shadow near said operating position. 

15 (14) The image diagnosis supporting device 

according to item (10), wherein said control-display 
unit comprises unit for displaying a marker surrounding 
said abnormal candidate shadow extracted by said 
extracting unit. 

20 (15) The image diagnosis supporting device 

according to item (14), wherein said extracting unit 
comprises unit for detecting focus certainty of said 
extracted abnormal candidate shadow, and said control- 
display unit comprises unit for displaying said marker 

25 in a different display form based on said detected 
focus certainty. 

(16) The image diagnosis supporting device 

according to item (14), wherein said display unit 
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comprises unit for erasing overlapped areas and 
providing display if markers overlap each other as they 
surround a plurality of said abnormal candidate 
shadows . 

5 (17) The image diagnosis supporting device 

according to item (14), wherein said control-display 
unit comprises unit for contrast-highlighting or gamma 
processing-highlighting the area surrounded by said 
marker and clearly displaying said abnormal candidate 
10 shadow. 

(18) The image diagnosis supporting device 
according to item (10) , wherein said control-display 
unit does not provide said identifiable display for a 
medical image of which reading by a doctor is not 

15 completed. 

(19) An image diagnosis supporting device 
comprising : 

digitizing unit for applying predetermined 
image processing to a medical image and generating a 
20 multi-valued image; 

extracting unit for executing at least one 
decision making processing routine on said multi-valued 
image generated by said digitizing unit and extracting 
an abnormal candidate shadow; 
25 display unit for displaying in said medical 

image said abnormal candidate shadow extracted by said 
extracting unit so that it is easily identifiable; 

unit for designating a display area in said 
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medical image where an abnormal candidate shadow 
existed after sequentially displaying said medical 
images on said display unit while changing a slice 
position at which said medical images are adjacent each 
5 other; 

unit for retrieving a medical . image of which 
the display area is identical in position to the 
display area designated by said designating unit, of 
said sequentially displayed medical images; and 
10 control-display unit for control-displaying 

on said display unit a medical image including the 
abnormal candidate shadow retrieved by said retrieving 
unit . 

(20) The image diagnosis supporting device 

15 according to item (19), wherein said control-display 

unit comprises unit for displaying a magnified image of 
an area including said abnormal candidate shadow in 
said medical image or an area other than said medical 
image . 

20 (21) The image diagnosis supporting device 

according to item (19), wherein said control-display 
unit comprises unit for displaying a marker surrounding 
said abnormal 'candidate shadow extracted by said 
extracting unit. 

25 (22) The image diagnosis supporting device 

according to item (21), wherein said extracting unit 
comprises unit for detecting focus certainty of said 
extracted abnormal candidate shadow, and said control- 



display unit comprises unit for displaying said marker 
in a different display form based on said detected 
focus certainty and providing display. 
(23) The image diagnosis supporting device 

5 according to item (21), wherein said display unit 
comprises unit for erasing overlapped areas and 
providing display if markers overlap each other as they 
surround a plurality of said abnormal candidate 
shadows . 

10 (24) The image diagnosis supporting device 

according to item (21) , wherein said control-display 
unit comprises unit for contrast-highlighting or gamma 
processing-highlighting the area surrounded by said 
marker and clearly displaying said abnormal candidate 

15 shadow. 

(25) The image diagnosis supporting device 
according to item (19), wherein said control-display 
unit does not provide said identifiable display for a 
medical image of which reading by a doctor is not 

2 0 completed. 

(26) An image diagnosis supporting device 
comprising : 

digitizing unit for applying predetermined 
image processing to a medical image and generating a 
.25 multi-valued image; 

extracting unit for executing at least one 
decision making processing routine on said multi-valued 
image generated by said digitizing unit and extracting 



an abnormal candidate shadow; 

display unit for displaying in said medical 
image said abnormal candidate shadow extracted by said 
extracting unit so that it is easily identifiable; 
5 unit for reading medical images immediately 

following and immediately preceding the medical image 
that is currently displayed when said medical images 
are sequentially displayed on said display unit while 
changing a slice position at which said medical images 

10 are adjacent to each other; and 

control-display unit for control-displaying 
the immediately following and immediately preceding 
medical images read by said reading unit on display 
areas of said display unit adjacent to said image that 

15 is currently displayed. 

(27) The image diagnosis supporting device 
according to item (26) , wherein said control-display 
unit comprises unit for displaying a magnified image of 
an area including said abnormal candidate shadow in 

20 said medical image or an area other than said medical 
image . 

(28) The image diagnosis supporting device 
according to item (26), wherein said control-display 
unit comprises unit for controlling an order of display 

25 of said abnormal candidate shadow according to its 
position in said medical image and displaying said 
medical image. 

(29) The image diagnosis supporting device 
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according to item (28), wherein said control-display 
unit comprises unit for controlling the order of 
display of said abnormal candidate shadow according to 
its pointing device operating position in said medical 
5 image and displaying said medical image having said 

abnormal candidate shadow near said operating position. 

(30) The image diagnosis supporting device 
according to item (26) , wherein said control-display 
unit comprises unit for displaying a marker surrounding 

10 said abnormal candidate shadow extracted by said 
extracting unit. 

(31) The image diagnosis supporting device 
according to item (30), wherein said extracting unit 
comprises unit for detecting focus certainty of said 

15 extracted abnormal candidate shadow, and said control- 
display unit comprises unit for displaying said marker 
in a different display form based on said detected 
focus certainty and providing display. 

(32) The image diagnosis supporting device 
20 according to item (30), wherein said display unit 

comprises unit for erasing overlapped areas and 
providing display if markers overlap each other as they 
surround a plurality of said abnormal candidate 
shadows . 

25 (33) The image diagnosis supporting device 

according to item (30), wherein said control-display 
unit comprises unit for contrast-highlighting or gamma 
processing-highlighting the area surrounded by said 
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marker and clearly displaying said abnormal candidate 
shadow . 

(34) The image diagnosis supporting device 
according to item (26) , wherein said control-display 

5 unit does not provide said identifiable display for a 
medical image of which reading by a doctor is not 
completed. 

(35) An image diagnosis supporting device 
displaying medical images in order while shifting the 

10 same vertically and laterally on a display screen so 
that an area in which an abnormal candidate shadow 
exists and a position at which a marker indicating the 
area are almost fixed in the display screen. 

It should be further understood by those 

15 skilled in the art that although the foregoing 
description has been made on embodiments of the 
invention, the invention is not limited thereto and 
various changes and modifications may be made without 
departing from the spirit of the invention and the 

20 scope of the appended items. 



